-- Logs begin at Mon 2022-07-18 15:49:37 UTC, end at Mon 2022-07-18 17:10:00 UTC. -- Jul 18 16:40:41.914221 dv-cinder-846173-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 16:40:41.923657 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:40:41 2022] *** Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: nodename: dv-cinder-846173-3-iscsi Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: machine: x86_64 Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: clock source: unix Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: pcre jit disabled Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: detected number of CPU cores: 4 Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: current working directory: / Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:40:41.925680 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: your processes number limit is 47680 Jul 18 16:40:41.926497 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: your memory page size is 4096 bytes Jul 18 16:40:41.926497 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: detected max file descriptor number: 2048 Jul 18 16:40:41.926497 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: lock engine: pthread robust mutexes Jul 18 16:40:41.926497 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: thunder lock: enabled Jul 18 16:40:41.926497 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 16:40:41.926497 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:40:41.966057 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: Python main interpreter initialized at 0x5654911a79c0 Jul 18 16:40:41.966057 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: python threads support enabled Jul 18 16:40:41.966057 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: your server socket listen backlog is limited to 100 connections Jul 18 16:40:41.966057 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:40:41.966445 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:40:41.966510 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: *** Operational MODE: preforking *** Jul 18 16:40:41.966744 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:40:41.966744 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: spawned uWSGI master process (pid: 110230) Jul 18 16:40:41.967045 dv-cinder-846173-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 16:40:41.968729 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: spawned uWSGI worker 1 (pid: 110231, cores: 1) Jul 18 16:40:41.968729 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: spawned uWSGI worker 2 (pid: 110232, cores: 1) Jul 18 16:40:41.968729 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:40:42.646873 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:40:42.647466 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:40:43.747519 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:40:43.747519 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: from cryptography.utils import int_from_bytes Jul 18 16:40:43.748169 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:40:43.748169 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: from cryptography.utils import int_from_bytes Jul 18 16:40:43.749204 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:40:43.749204 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: from cryptography.utils import int_from_bytes Jul 18 16:40:43.749766 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:40:43.749766 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: from cryptography.utils import int_from_bytes Jul 18 16:40:46.242691 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:40:46.243348 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:40:46.243707 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:40:46.243807 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:40:46.243890 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:40:46.243973 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:40:46.243973 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:40:46.244106 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:40:46.244177 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:40:46.244249 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:40:46.244527 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.244638 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.244854 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.244975 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.245203 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.245387 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.245526 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.245629 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.245863 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.245969 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.246177 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.246271 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.246501 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.246596 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.246816 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.246907 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.247148 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.247241 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.247405 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.247499 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.247721 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.247815 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.248049 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-3-iscsi {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.248141 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-3-iscsi {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.248374 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.248467 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.248680 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.248775 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.249023 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.249112 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.249348 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.249442 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.249656 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.249760 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.249984 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.250076 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.250291 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.250381 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.250786 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.250893 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.251945 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252089 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252089 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252310 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252399 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252478 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252567 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252656 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252740 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252829 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.252923 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.253018 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.253109 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.253244 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.253374 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.253467 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.253698 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.253801 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.253995 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.254087 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.254395 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-3-iscsi {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.254485 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-3-iscsi {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.254714 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.254812 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.255026 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.255115 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.255341 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.255480 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.255755 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.255858 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.256066 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.256157 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.256377 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.256463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.256697 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.256782 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.257053 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.257176 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.257374 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.257629 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.257739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.258002 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.258772 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.259169 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.259606 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.259832 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.259929 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.260141 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.260241 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.260460 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.260554 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.260777 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.260975 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.261155 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.261289 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.261442 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.261527 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.261746 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.261835 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.261997 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.262096 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.262292 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.262380 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.262604 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.262693 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.262930 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.263019 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.263282 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.263373 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.263544 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.263637 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.263780 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.263876 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.264059 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.264151 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.264383 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.264496 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.264724 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.264816 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.265019 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.265112 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.265333 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.265434 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.265639 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.265733 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.265947 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.266041 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.266257 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.266346 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.266562 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.266656 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.266866 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.266959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.267174 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.267276 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.267529 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.267815 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.267907 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.268142 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.268232 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.268452 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.268546 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.268776 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.268898 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.269218 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.269307 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.269472 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.269567 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.269783 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.269877 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.270125 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.270220 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.270450 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.270538 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.270760 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.270871 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.271076 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.271183 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.271399 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.271495 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.271708 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.271796 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.272019 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.272171 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.272315 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.272464 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.272631 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.272784 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.272966 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.273184 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.273327 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.273468 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.273610 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.273746 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.273910 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.274862 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.275017 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.275153 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.275299 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.275519 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.275672 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.275820 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.275962 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.276097 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.276230 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.276368 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.276518 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.276653 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.276786 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.276954 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.277101 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.277242 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.277242 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.277521 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.277662 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.277795 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.277935 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.278075 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.278217 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.278360 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.278500 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.278633 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.278772 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.278905 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.279054 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.279193 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.279343 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.279478 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.279610 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.279751 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.279885 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.280024 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.280167 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.280301 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.280433 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.280575 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.280719 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.280870 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.281056 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.281282 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.281540 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.281688 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.281832 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.281967 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.282100 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.282234 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.282374 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.282513 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.282660 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.282801 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.282935 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.283096 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.283239 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.283386 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.283528 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.283662 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.283804 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.283945 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.284080 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.284227 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.284362 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.284495 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.284635 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.284770 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.284958 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.285110 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.285254 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.285389 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.285540 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.285750 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.285890 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.286038 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.286174 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.286306 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.286447 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.286592 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.286735 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.286879 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.287023 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.287158 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.287299 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.287434 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.287575 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.287709 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.287842 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.287975 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.288107 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.288254 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.288402 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.288537 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.288680 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.288830 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.289018 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.289154 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:40:46.289324 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.289502 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.289682 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.289904 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.290046 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.290189 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.290330 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.290514 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.290673 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.290852 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.291007 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.291189 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.291412 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.291553 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.291687 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.291819 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.291959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.292106 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.292256 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.292440 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.292597 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.292757 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.292939 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.293111 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.293252 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.293430 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.293570 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.293750 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.293907 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.294067 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.294276 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.294412 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.294543 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.294686 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.294834 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.294977 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.295112 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.295291 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.295433 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.295608 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.295775 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.296093 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.296234 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.296368 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.296509 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.296645 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.296796 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.296990 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.297129 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.297263 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.297408 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.297543 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.297684 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.297850 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.297991 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.298175 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.298316 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.298491 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.298650 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.298796 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.298931 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.299102 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.299243 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.299413 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.299552 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.299743 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.299884 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.300054 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.300195 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.300376 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.300518 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.300692 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.300834 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.301030 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.301171 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.301340 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.301567 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.301709 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.301849 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.301983 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.302118 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.302259 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.302393 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.302580 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.302739 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.302874 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.303014 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.303193 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.303335 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.303490 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.303625 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.303814 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.303962 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.304128 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.304275 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.304437 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.304577 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.304746 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.304934 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.305090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.305227 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.305396 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.305545 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.305708 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.305865 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.306007 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.306233 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.306382 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.306516 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.306650 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.306805 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.306946 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.307080 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.307251 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.307391 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.307558 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.307698 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.307873 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.308021 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.308185 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.308333 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.308499 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.308656 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.308797 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.308968 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.309116 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.309250 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.309427 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.309569 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.309737 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.309894 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.310027 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.310169 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.310358 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.310506 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.310770 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.310914 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.311058 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.311199 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.311340 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.311480 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.311699 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.311839 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.311973 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.312121 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.312264 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.312398 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.312538 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.312691 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.312827 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.313024 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.313161 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.313295 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.313426 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.313566 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.313720 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.313855 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.313997 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.314138 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.314301 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.314462 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.314634 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.314784 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.314943 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.315085 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.315266 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.315412 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.315588 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.315729 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.315907 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.316061 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.316219 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.316424 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.316592 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.316728 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.316862 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.317032 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.317166 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.317311 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.317458 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.317599 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.317740 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.317875 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.318016 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.318158 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.318338 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.318495 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.318630 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.318775 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.318982 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.319197 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.319342 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.319517 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.319651 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.319785 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.319919 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.320065 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.320208 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.320342 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.320526 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.320667 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.321343 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.321491 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.321690 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.321896 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.322044 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.322179 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.322320 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.322455 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.322597 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.322733 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.322866 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.323009 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.323221 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.323358 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.323491 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.323634 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.323768 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.323942 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.324093 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.324229 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.324373 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.324517 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.324651 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.324796 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.324966 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.325115 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.325266 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.325408 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.325559 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.325709 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.325850 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.325996 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.326137 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.326278 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.326442 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.326669 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.326828 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.326969 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.327109 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.327250 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.327389 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.327543 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.327693 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.327835 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.328104 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.328249 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.328392 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.328542 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.328684 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.328835 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.329038 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.329182 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.329332 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.329481 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.329622 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.329762 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.329902 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.330041 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.330197 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.330347 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.330489 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.330629 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.330780 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.330927 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.331077 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.331218 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.331358 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.331507 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.331648 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.331788 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.332020 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.332169 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.332316 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.332466 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.332608 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.332758 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.332924 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.333071 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.333211 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.333351 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.333497 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.333653 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.333795 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.333945 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.334098 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.334247 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.334389 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.334542 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.334706 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.334848 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.334988 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.335158 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.335307 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.335485 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.335635 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.335802 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.335949 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.336090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.336229 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.336429 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.337182 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.337331 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.337486 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.337636 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.337789 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.337938 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.338080 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.338220 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.338360 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.338508 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.338658 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.338800 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.338940 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.339091 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.339238 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.339387 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.339547 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.339688 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.339829 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.339969 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.340109 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.340248 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.340397 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.340538 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.340719 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.340866 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.341049 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.341202 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.341344 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.341494 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.341636 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.341776 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.341918 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.342344 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.342496 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.342637 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.342778 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.342918 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.343067 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.343231 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.343373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.343587 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.343745 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.343887 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.344029 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.344181 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.344330 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.344471 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.344619 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.344768 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.344960 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.345120 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.345273 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.345414 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.345554 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.345703 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.345854 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.345995 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.346136 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.346284 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.346425 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.346566 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.346714 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.346863 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.347022 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.347183 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.347394 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.347547 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.347698 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.347840 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.347988 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.348130 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.348271 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.348411 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.348565 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.348707 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.348854 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.349041 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.349194 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.349346 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.349488 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.349635 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.349787 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.349936 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.350084 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.350234 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.350377 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.350517 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.350657 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.350657 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.351195 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.351347 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.351489 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.351630 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.351776 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.351925 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.352185 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.352422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.352580 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.352729 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.352871 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.353073 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.353237 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.353389 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.353533 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.353682 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.353913 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.354076 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.354225 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.354375 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.354519 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.354668 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.354824 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.354974 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.355116 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.355268 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.355408 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.355559 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.355712 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.355854 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.356001 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.356143 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.356291 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.356434 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.356583 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.356725 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.356875 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.357045 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.357212 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.357355 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.357584 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.357731 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.357872 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.358013 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.358167 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.358310 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.358450 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.358598 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.358740 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.358880 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.359033 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.359193 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.359336 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.359476 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.359616 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.359766 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.359908 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.360051 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.360192 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.360340 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.360481 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.360631 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.360782 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.360996 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.361145 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.361293 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.361453 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.361711 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.361873 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.362016 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.362164 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.362306 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.362693 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.362834 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.362975 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.363127 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.363277 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.363467 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.363616 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.363756 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.363896 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.364038 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.364185 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.364340 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.364482 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.364743 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.364921 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.365083 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.365238 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.365392 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.365535 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.365684 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.365826 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.365967 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.366116 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.366258 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.366398 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.366539 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.366679 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.366819 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.366977 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.367120 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.367261 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.367402 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.367549 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.367820 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.367978 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.368129 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.368271 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.368412 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.368559 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.368701 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.368850 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.369045 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.369200 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.369343 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.369484 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.369638 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.369786 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.369928 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.370068 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.370209 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.370350 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.370498 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.370640 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.370781 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.370931 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.371072 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.371220 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.371371 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.371513 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.371653 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.371794 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.371942 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.372082 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.372235 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.372377 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.372535 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.372746 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.372936 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.373098 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.373251 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.373392 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.373541 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.373691 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.373832 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.374103 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.374249 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.374390 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.374533 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.374673 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.374814 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.374972 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.375114 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.375255 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.375395 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.375537 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.375685 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.375899 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.376043 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.376184 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.376325 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.376465 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.376615 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.376775 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.376965 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.377113 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.377253 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.377394 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.377551 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.377702 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.377925 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.378073 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.378214 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.378354 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.378507 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.378650 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.378813 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.378955 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.379095 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.379235 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.379383 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.379524 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.379666 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.379805 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.379953 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.380103 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.380251 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.380391 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.380532 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.380681 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.380822 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.381005 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.381149 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.381289 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.381429 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.381568 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.381708 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.381857 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.382007 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.382147 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.382295 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.382436 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.382594 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.382766 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.382978 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.383133 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.383783 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.383926 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.384073 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.384225 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.384366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.384506 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.384646 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.384793 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.384972 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.385131 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.385279 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.385428 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.385570 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.385709 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.385862 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.386005 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.386146 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.386286 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.386433 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.386581 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.386734 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.386883 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.387033 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.387180 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.387320 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.387459 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.387617 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.387767 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.387934 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.388146 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.388292 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.388445 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.388594 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.388736 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.388907 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.389054 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.389207 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.389363 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.389505 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.389652 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.389800 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.389947 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.389947 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.390233 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.390374 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.390514 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.390514 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.390803 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.390944 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.391097 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.391249 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.391390 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.391531 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.391670 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.391824 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.391965 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.392106 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.392365 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.392522 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.392673 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.392837 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.393120 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.393276 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.393419 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.393569 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.393710 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.393860 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.394002 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.394142 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.394291 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.394446 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.394588 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.394753 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.394895 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.395035 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.395175 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.395315 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.395464 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.395607 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.395747 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.395887 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.396027 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.396167 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.396325 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.396477 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.396629 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.396779 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.396944 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.397092 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.397249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.397392 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.397534 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.397676 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.397817 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.397957 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.398107 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.398348 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.398503 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.398656 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.398798 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.399012 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.399157 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.399300 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.399447 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.399590 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.399731 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.399881 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.400023 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.400165 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.400313 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.400463 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.400616 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.400770 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.400986 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.401136 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.401285 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.401426 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.401567 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.401728 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.401870 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.402011 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.402151 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.402306 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.402469 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.402611 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.402752 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.402893 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.403032 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.403261 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.403428 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.403572 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.403712 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.403874 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.404024 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.404173 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.404329 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.404482 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.404641 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.404784 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.404951 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.405097 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.405240 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.405240 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.405519 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.405840 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.405987 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.406156 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.406304 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.406481 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.406652 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.406852 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.407007 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.407185 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.407348 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.407503 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.407653 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.407824 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.408095 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.408241 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.408469 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.408632 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.408786 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.409001 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.409150 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.409301 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.409487 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.409646 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.409789 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.409929 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.410071 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.410211 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.410352 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.410500 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.410649 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.410813 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.410963 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.411105 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.411256 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.411397 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.411537 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.411677 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.411818 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.411958 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.412111 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.412254 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.412395 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.412542 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.412700 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.412841 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.413033 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.413135 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.413222 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.413302 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.413455 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.413555 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.413785 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.413877 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.414096 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.414187 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.415388 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.415551 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.415551 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.415713 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.415793 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.415872 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.415958 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.416047 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.416260 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.416351 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.416549 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.416714 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.416859 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.417026 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.417186 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.417284 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.417497 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.417584 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.417811 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.417911 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.418163 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.418248 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.418518 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.418616 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.418798 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.418883 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.419119 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.419212 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.419450 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.419544 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.419758 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.419853 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.420067 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.420152 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.420380 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.420473 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.420687 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.420773 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.421041 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.421173 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.421344 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.421431 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.421657 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.421744 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.421965 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.422050 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.422270 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.422431 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.422576 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.422663 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.422881 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.422966 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.423195 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.423288 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.423515 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.423612 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.423819 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.423903 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.424122 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.424220 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.424426 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.424510 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.424733 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.424828 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.425077 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.425176 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.425411 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.425593 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.425728 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.425943 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.426037 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.426270 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.426382 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.426599 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.426726 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.426933 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.427076 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.427247 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.427373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.427578 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.427704 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.427899 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.428032 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.428215 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.428338 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.428535 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.428741 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.428865 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.429023 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.429182 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.429305 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.429501 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.429624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.429821 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.429948 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.430190 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.430838 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.430959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.431138 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.431349 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.431528 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.431717 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.431891 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.432018 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.432155 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.432289 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.432457 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.432583 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.432776 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.432942 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.433118 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.433258 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.433434 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.433754 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.433887 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.434070 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.434207 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.434385 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.434511 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.434699 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.434832 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.435012 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.435146 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.435324 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.435450 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.435640 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.435763 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.435959 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.436095 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.436278 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.436404 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.436596 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.436722 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.437090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.437231 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.437368 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.437499 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.437632 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.437755 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.437890 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.438012 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.438243 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.438382 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.438560 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.438694 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.438899 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.439024 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.439151 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.439273 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.439472 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.439607 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.439789 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.439913 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.440102 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.440226 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.440418 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.440545 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.440736 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.440860 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.441078 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.441203 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.441392 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.441529 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.441706 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.441830 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.442017 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.442140 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.442333 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.442458 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.442652 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.442776 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.442967 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.443091 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.443283 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.443408 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.443599 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.443868 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.444009 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.444139 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.444261 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.444379 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.444559 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.444735 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.444905 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.445085 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.445212 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.445429 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.445561 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.445850 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.445989 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.446120 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.446376 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.446503 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.446696 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.446831 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.447034 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.447160 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.447357 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.447481 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.447674 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.447808 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.448092 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.448229 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.448403 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.448569 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.448690 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.448809 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.449056 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.449183 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.449304 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.449423 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.449542 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.449663 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.449862 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.449989 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.450218 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.450352 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.450498 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.450711 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.450838 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.451065 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.451189 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.451383 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.451508 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.451711 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.451837 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.452040 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.452258 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.452385 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.452611 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.452746 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.452956 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.453088 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.453291 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.453419 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.453598 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.453770 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.453975 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.454100 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.454222 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.454342 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.454550 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.454677 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.454864 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.454989 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.455174 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.455298 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.455488 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.455627 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.455796 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.455922 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.456100 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.456224 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.456405 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.456528 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.456717 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.456841 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.457054 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.457179 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.457360 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.457484 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.457669 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.457793 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.457974 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.458111 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.458279 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.458404 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.458586 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.458711 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.458891 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.459039 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.459233 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.459360 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.459488 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.459607 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.459784 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.459978 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.460091 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.460209 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.460381 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.460507 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.460689 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.460826 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.461017 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.461143 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.461825 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.461959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.462148 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.462284 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.462459 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.462585 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.462775 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.462900 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.463084 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.463210 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.463397 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.463555 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.463709 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.463840 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.464050 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.464190 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.464344 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.464477 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.464657 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.464782 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.465001 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.465130 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.465320 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.465445 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.465649 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.465870 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.465998 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.466210 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.466334 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.466534 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.466659 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.466874 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.467008 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.467211 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.467440 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.467573 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.467783 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.467918 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.468108 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.468241 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.468446 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.468571 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.468782 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.468986 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.469121 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.469255 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.469442 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.469566 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.469719 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.469846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.470032 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.470154 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.470346 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.470470 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.470660 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.470784 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.470970 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.471100 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.471282 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.471414 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.471593 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.471717 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.471902 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.472027 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.472214 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.472346 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.472531 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.472663 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.472845 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.472988 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.473185 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.473333 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.473499 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.473633 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.473813 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.473938 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.474156 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.474300 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.474444 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.474570 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.474794 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.474919 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.475104 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.475229 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.475417 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.475552 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.475733 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.476105 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.476303 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.476427 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.476622 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.476755 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.477024 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.477658 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.477800 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.477923 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.478129 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.478255 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.478451 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.478587 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.478790 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.478908 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.479113 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.479227 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.479495 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.479640 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.479764 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.479884 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.480062 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.480187 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.480377 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.480518 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.480705 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.480829 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.481038 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.481174 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.481364 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.481491 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.481710 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.481835 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.482035 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.482160 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.482363 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.482497 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.482671 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.482795 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.482981 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.483106 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.483291 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.483416 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.483604 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.483728 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.483927 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.484052 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.484261 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.484394 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.484543 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.484682 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.484849 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.485016 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.485186 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.485310 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.485491 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.485616 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.485800 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.485934 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.486107 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.486231 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.486410 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.486534 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.486722 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.486859 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.487024 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.487148 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.487330 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.487462 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.487632 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.487758 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.487939 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.488064 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.488241 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.488368 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.488545 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.488680 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.488850 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.489003 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.489175 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.489299 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.489480 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.489683 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.489809 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.489929 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.490072 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.490190 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.490387 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.490526 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.490770 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.490902 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.491025 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.491154 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.491275 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.491409 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.491530 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.491660 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.491840 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.491975 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.492178 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.492310 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.492519 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.492739 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.492870 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.493061 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.493185 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.493305 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.493510 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.493635 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.493826 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.493962 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.494135 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.494258 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.494464 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.494589 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.494762 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.494889 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.495076 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.495201 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.495386 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.495509 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.495693 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.495817 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.496011 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.496136 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.496322 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.496444 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.496639 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.496777 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.496978 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.497104 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.497290 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.497426 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.497607 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.497733 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.497986 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.498109 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.498230 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.498364 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.498532 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.498657 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.498863 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.498986 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.499174 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.499308 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.499487 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.499617 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.499790 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.499923 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.500095 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.500235 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.500407 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.500532 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.500723 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.500968 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.501112 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.501235 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.501395 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.501524 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.501646 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.501766 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.501957 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.502083 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.502271 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.502397 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.502585 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.502720 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.502900 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.503032 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.503216 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.503339 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.503536 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.503672 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.503871 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.503997 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.504184 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.504308 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.504505 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.504644 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.504836 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.504995 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.505182 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.505306 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.505498 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.505639 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.505809 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.505933 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.506054 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:40:46.506182 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.506492 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.506814 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.507131 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.507443 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:40:46.507690 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:40:46.566877 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO dbcounter [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Registered counter for database nova_api Jul 18 16:40:46.568736 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO dbcounter [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Registered counter for database nova_api Jul 18 16:40:46.681528 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG oslo_db.sqlalchemy.engines [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:40:46.682808 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_db.sqlalchemy.engines [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:40:46.688095 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writer thread running {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:40:46.689261 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writer thread running {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:40:46.745746 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.context [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6070aaf7-16bd-4fe0-b966-c841d36d60dc(cell1) {{(pid=110232) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:40:46.745956 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.context [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6070aaf7-16bd-4fe0-b966-c841d36d60dc(cell1) {{(pid=110231) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:40:46.749690 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG oslo_concurrency.lockutils [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:46.749918 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:46.751274 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG oslo_concurrency.lockutils [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:46.751483 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:46.752082 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG oslo_concurrency.lockutils [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:46.752291 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:40:46.754237 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG oslo_concurrency.lockutils [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:46.754458 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:40:46.756216 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO dbcounter [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Registered counter for database nova_cell0 Jul 18 16:40:46.756476 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO dbcounter [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Registered counter for database nova_cell0 Jul 18 16:40:46.760118 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO dbcounter [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Registered counter for database nova_cell1 Jul 18 16:40:46.760387 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO dbcounter [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Registered counter for database nova_cell1 Jul 18 16:40:46.767549 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG oslo_db.sqlalchemy.engines [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:40:46.769803 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG oslo_db.sqlalchemy.engines [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:40:46.771844 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_db.sqlalchemy.engines [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:40:46.773110 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_db.sqlalchemy.engines [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:40:46.775438 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writer thread running {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:40:46.778799 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writer thread running {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:40:46.783079 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writer thread running {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:40:46.788300 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writer thread running {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:40:46.933873 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO dbcounter [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Registered counter for database nova_cell0 Jul 18 16:40:46.945693 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_db.sqlalchemy.engines [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:40:46.948501 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO dbcounter [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Registered counter for database nova_cell0 Jul 18 16:40:46.953790 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writer thread running {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:40:46.959580 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG oslo_db.sqlalchemy.engines [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:40:46.966228 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writer thread running {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:40:47.400157 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: WARNING keystonemiddleware.auth_token [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:40:47.407477 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: WARNING keystonemiddleware.auth_token [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:40:47.430926 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: WARNING keystonemiddleware.auth_token [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:40:47.438375 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: WARNING keystonemiddleware.auth_token [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:40:47.749118 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: WARNING keystonemiddleware.auth_token [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:40:47.755028 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: WARNING keystonemiddleware.auth_token [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:40:47.760814 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5654911a79c0 pid: 110231 (default app) Jul 18 16:40:47.762913 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:40:47.764107 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Jul 18 16:40:47.764516 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 788 bytes} [Mon Jul 18 16:40:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:40:47.785059 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: WARNING keystonemiddleware.auth_token [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:40:47.791171 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: WARNING keystonemiddleware.auth_token [None req-79834942-7685-4113-8be6-8a7b17d10a88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:40:47.796250 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5654911a79c0 pid: 110232 (default app) Jul 18 16:42:08.567331 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:08.568347 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 18 16:42:08.569296 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 2/2] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:08.585238 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writing DB stats nova_api:SELECT=3 {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:08.586204 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writing DB stats nova_cell0:SELECT=3 {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:08.587818 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writing DB stats nova_cell1:SELECT=3 {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:08.588680 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:09.464983 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-d073482b-2e16-418b-b8a5-9bc5548947cb admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:09.497992 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-d073482b-2e16-418b-b8a5-9bc5548947cb admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921842 Jul 18 16:42:09.498866 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 1/3] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 16:42:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:11.751358 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:11.752863 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-f955a19b-362c-4d4c-ad6a-ad278286b862 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001890 Jul 18 16:42:11.753583 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 3/4] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:12.289341 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-eaca5967-5b42-4ace-a26c-6a18b954e051 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 1, "name": "cirros256"}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:12.307940 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:42:12.307940 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: warnings.warn(msg) Jul 18 16:42:12.444583 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-eaca5967-5b42-4ace-a26c-6a18b954e051 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.682730 Jul 18 16:42:12.449044 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 2/5] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:12.460190 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_api:SELECT=3 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:12.461087 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_cell0:SELECT=3 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:12.462633 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_cell1:SELECT=3 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:12.463753 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:12.676021 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-c82aed11-19cc-48e0-a372-4478b4023458 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:12.678408 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:42:12.678408 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: warnings.warn(msg) Jul 18 16:42:12.845225 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-c82aed11-19cc-48e0-a372-4478b4023458 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.390584 Jul 18 16:42:12.846717 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 4/6] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 16:42:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:15.086332 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-eaca5967-5b42-4ace-a26c-6a18b954e051 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:15.087879 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-eaca5967-5b42-4ace-a26c-6a18b954e051 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Jul 18 16:42:15.088319 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 3/7] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:15.888278 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-b986b391-c025-4fa5-afd4-4848cec9340b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "ram": 512}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:15.908754 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:42:15.908754 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: warnings.warn(msg) Jul 18 16:42:16.052537 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-b986b391-c025-4fa5-afd4-4848cec9340b admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.957747 Jul 18 16:42:16.053125 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 5/8] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:16.066071 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-a858e148-639d-42d0-8089-b1bc396a9682 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:16.067945 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:42:16.067945 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: warnings.warn(msg) Jul 18 16:42:16.209487 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-a858e148-639d-42d0-8089-b1bc396a9682 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146995 Jul 18 16:42:16.221042 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 4/9] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 16:42:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:18.513966 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-b986b391-c025-4fa5-afd4-4848cec9340b admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:18.514973 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-b986b391-c025-4fa5-afd4-4848cec9340b admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Jul 18 16:42:18.515553 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 6/10] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:18.937217 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-168eae82-cffe-455f-b35e-66e0eff6d785 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:19.017764 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-168eae82-cffe-455f-b35e-66e0eff6d785 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496338 Jul 18 16:42:19.021188 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 5/11] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:19.031172 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-c7d6dc78-1e34-4355-89a8-74019e080960 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:19.116757 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-c7d6dc78-1e34-4355-89a8-74019e080960 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089747 Jul 18 16:42:19.117368 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 7/12] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 16:42:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:21.349275 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-168eae82-cffe-455f-b35e-66e0eff6d785 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:21.350317 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-168eae82-cffe-455f-b35e-66e0eff6d785 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jul 18 16:42:21.350717 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 6/13] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:21.845365 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-904e47c4-a23d-4602-8c3a-3b4bec486be5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:21.940042 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-904e47c4-a23d-4602-8c3a-3b4bec486be5 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.583292 Jul 18 16:42:21.940933 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 8/14] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:21.953365 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-84a6def0-757c-4f45-a9c7-293d9558653e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:22.042129 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-84a6def0-757c-4f45-a9c7-293d9558653e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092272 Jul 18 16:42:22.042710 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 7/15] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 16:42:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:42:24.250928 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-904e47c4-a23d-4602-8c3a-3b4bec486be5 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:24.251929 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-904e47c4-a23d-4602-8c3a-3b4bec486be5 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 18 16:42:24.252512 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 9/16] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:24.711160 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-fc8428b3-c329-4cb0-aabb-9fe036676d71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "disk": 20, "vcpus": 4, "ram": 4096}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:24.792213 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-fc8428b3-c329-4cb0-aabb-9fe036676d71 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.532894 Jul 18 16:42:24.793180 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 8/17] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:42:24.804811 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-963f30e0-6c18-4357-8853-728079710642 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:24.882880 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-963f30e0-6c18-4357-8853-728079710642 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081695 Jul 18 16:42:24.884267 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 10/18] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 18 16:42:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:27.113522 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-fc8428b3-c329-4cb0-aabb-9fe036676d71 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:27.114529 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-fc8428b3-c329-4cb0-aabb-9fe036676d71 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 18 16:42:27.114943 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 9/19] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:27.575747 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-54b32229-39c4-4466-8844-0fdb96ba1837 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:27.600659 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-54b32229-39c4-4466-8844-0fdb96ba1837 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479382 Jul 18 16:42:27.601314 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 11/20] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 16:42:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:42:29.925234 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-fc8428b3-c329-4cb0-aabb-9fe036676d71 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:29.926263 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-fc8428b3-c329-4cb0-aabb-9fe036676d71 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 18 16:42:29.926756 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 10/21] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:30.361374 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-40652b7a-3ab2-41ff-9b3e-c6d844fe9f24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "disk": 1}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:30.474931 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-40652b7a-3ab2-41ff-9b3e-c6d844fe9f24 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.540481 Jul 18 16:42:30.475760 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 12/22] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:42:30.488233 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-c22ee3a5-2ed5-4702-8816-275da70a7b0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:30.598892 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-c22ee3a5-2ed5-4702-8816-275da70a7b0d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114100 Jul 18 16:42:30.599491 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 11/23] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 16:42:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:32.983429 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-40652b7a-3ab2-41ff-9b3e-c6d844fe9f24 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:32.984358 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-40652b7a-3ab2-41ff-9b3e-c6d844fe9f24 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 18 16:42:32.984761 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 13/24] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:33.485087 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-61aa8f20-98ac-4e94-8c89-b50d9da7650e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:33.610963 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-61aa8f20-98ac-4e94-8c89-b50d9da7650e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.619482 Jul 18 16:42:33.611478 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 12/25] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:33.626938 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-79feb4d8-8290-4c83-ab1e-3e021ed1d943 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:33.753144 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-79feb4d8-8290-4c83-ab1e-3e021ed1d943 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131960 Jul 18 16:42:33.753828 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 14/26] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 16:42:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:36.120348 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-61aa8f20-98ac-4e94-8c89-b50d9da7650e admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:36.121408 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-61aa8f20-98ac-4e94-8c89-b50d9da7650e admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 18 16:42:36.121820 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 13/27] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:36.488029 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-0bb472d7-3ded-4e02-9355-2a5ed1d424c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:37.482535 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-0bb472d7-3ded-4e02-9355-2a5ed1d424c3 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.354272 Jul 18 16:42:37.483588 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 15/28] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:37.496447 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-be13b2a6-f5d7-4c56-b080-0491a40fd065 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:37.660764 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-be13b2a6-f5d7-4c56-b080-0491a40fd065 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.168648 Jul 18 16:42:37.661414 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 14/29] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 16:42:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:39.924783 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-0bb472d7-3ded-4e02-9355-2a5ed1d424c3 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:39.925842 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-0bb472d7-3ded-4e02-9355-2a5ed1d424c3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 18 16:42:39.926391 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 16/30] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:40.389712 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-01327415-98e1-4fb0-abf6-544fc14f1865 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "name": "m1.large"}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:40.394654 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:40.497033 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-01327415-98e1-4fb0-abf6-544fc14f1865 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.563710 Jul 18 16:42:40.497591 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 15/31] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:40.510063 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-8c10633c-5f7c-406a-a8a7-26a337f88861 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:40.660727 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-8c10633c-5f7c-406a-a8a7-26a337f88861 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154639 Jul 18 16:42:40.661622 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 17/32] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 16:42:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:42:42.921301 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-01327415-98e1-4fb0-abf6-544fc14f1865 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:42:42.922916 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-01327415-98e1-4fb0-abf6-544fc14f1865 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Jul 18 16:42:42.923313 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 16/33] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:42:43.381774 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-b82bdd29-c9e1-4e76-afc7-b97c33946e64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "swap": 0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:43.386661 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:43.473957 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-b82bdd29-c9e1-4e76-afc7-b97c33946e64 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.543351 Jul 18 16:42:43.474785 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 18/34] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 18 16:42:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:42:43.488035 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-e65f0a63-532b-4c08-9f49-4160acbb1611 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:42:43.649765 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-e65f0a63-532b-4c08-9f49-4160acbb1611 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.166162 Jul 18 16:42:43.664065 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 17/35] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 18 16:42:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:03.878299 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-b82bdd29-c9e1-4e76-afc7-b97c33946e64 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:03.879403 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-b82bdd29-c9e1-4e76-afc7-b97c33946e64 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jul 18 16:43:03.879876 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 19/36] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:04.275851 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-74a8fe05-ee68-491e-a0ee-8d141c4e327f admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:04.293401 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-74a8fe05-ee68-491e-a0ee-8d141c4e327f admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406578 Jul 18 16:43:04.293943 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 18/37] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 16:43:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:05.422142 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-b82bdd29-c9e1-4e76-afc7-b97c33946e64 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:05.423148 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-b82bdd29-c9e1-4e76-afc7-b97c33946e64 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 18 16:43:05.423547 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 20/38] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:05.963792 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-69c8d938-4df9-4d08-b87d-dec8a49c027c admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:05.969451 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.wsgi [None req-69c8d938-4df9-4d08-b87d-dec8a49c027c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-69c8d938-4df9-4d08-b87d-dec8a49c027c admin admin] Request method failure captured: Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Accept: application/json Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Accept-Encoding: gzip, deflate Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Connection: keep-alive Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Content-Length: 0 Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Host: 10.222.0.88 Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Openstack-Api-Version: compute 2.90 Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Openstack-System-Scope: None Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: User-Agent: python-novaclient Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Auth-Token: gAAAAABi1Y2ZzXICkS6ADYOZjrN0T68n62pRBwkAfwNOWYFxeJPP0vrNVhRy3fjLq3phdyNeaZNvMH21l_Xq141FJYdOP1vbTnK3TSzJ0US6mxhu5P7b1aYUEpEJU6HvPzBFhJSbni9TSvTng18a0-mHfTh7AtgPu3e2X8Wc-qQWCd18ajcB8_g Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Domain-Id: None Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Domain-Name: None Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Identity-Status: Confirmed Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Is-Admin-Project: True Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Domain-Id: default Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Domain-Name: Default Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Name: admin Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Role: member,admin,reader Jul 18 16:43:05.973090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Roles: member,admin,reader Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb46b30ed74742b9a95d61944ef39381", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}] Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant: admin Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant-Name: admin Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User: admin Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Domain-Id: default Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Domain-Name: Default Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Id: 264c9bf15b9849a18b942d5d77559b9b Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Name: admin Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: method: > Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: exception: Flavor 42 could not be found. Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: action_args: {'id': '42'} Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:05.974463 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:05.977422 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:05.978783 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-69c8d938-4df9-4d08-b87d-dec8a49c027c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:05.980090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-69c8d938-4df9-4d08-b87d-dec8a49c027c admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.407706 Jul 18 16:43:05.980090 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 19/39] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 16:43:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:05.984452 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-ce04613d-cc88-4f11-82a6-7ac8544158a2 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:06.005560 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-ce04613d-cc88-4f11-82a6-7ac8544158a2 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024899 Jul 18 16:43:06.012737 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 21/40] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 16:43:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:06.021098 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-3ac5405e-007d-4cff-b2a3-e6803d44306e admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:06.042542 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-3ac5405e-007d-4cff-b2a3-e6803d44306e admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024972 Jul 18 16:43:06.043104 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 20/41] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 16:43:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:06.052532 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-fbeabb58-f021-4070-b1f0-98547c69fdf7 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:06.059139 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.wsgi [None req-fbeabb58-f021-4070-b1f0-98547c69fdf7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-fbeabb58-f021-4070-b1f0-98547c69fdf7 admin admin] Request method failure captured: Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Accept: application/json Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Accept-Encoding: gzip, deflate Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Connection: keep-alive Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Content-Length: 0 Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Host: 10.222.0.88 Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Openstack-Api-Version: compute 2.90 Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Openstack-System-Scope: None Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: User-Agent: python-novaclient Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Auth-Token: gAAAAABi1Y2ZzXICkS6ADYOZjrN0T68n62pRBwkAfwNOWYFxeJPP0vrNVhRy3fjLq3phdyNeaZNvMH21l_Xq141FJYdOP1vbTnK3TSzJ0US6mxhu5P7b1aYUEpEJU6HvPzBFhJSbni9TSvTng18a0-mHfTh7AtgPu3e2X8Wc-qQWCd18ajcB8_g Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Domain-Id: None Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Domain-Name: None Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Identity-Status: Confirmed Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Is-Admin-Project: True Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Domain-Id: default Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Domain-Name: Default Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Name: admin Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Role: member,admin,reader Jul 18 16:43:06.062373 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Roles: member,admin,reader Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb46b30ed74742b9a95d61944ef39381", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}] Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant: admin Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant-Name: admin Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User: admin Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Domain-Id: default Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Domain-Name: Default Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Id: 264c9bf15b9849a18b942d5d77559b9b Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Name: admin Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: method: > Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: exception: Flavor 42 could not be found. Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: action_args: {'id': '42'} Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:06.070366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:06.071886 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:06.073188 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-fbeabb58-f021-4070-b1f0-98547c69fdf7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:06.074515 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-fbeabb58-f021-4070-b1f0-98547c69fdf7 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014748 Jul 18 16:43:06.074515 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 22/42] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 16:43:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:07.055547 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-3ac5405e-007d-4cff-b2a3-e6803d44306e admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:07.056570 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-3ac5405e-007d-4cff-b2a3-e6803d44306e admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 Jul 18 16:43:07.057004 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 21/43] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:07.607197 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-85cbfc00-3126-4fea-9c66-1146a49b1fca admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:07.613350 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.wsgi [None req-85cbfc00-3126-4fea-9c66-1146a49b1fca admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-85cbfc00-3126-4fea-9c66-1146a49b1fca admin admin] Request method failure captured: Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Accept: application/json Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Accept-Encoding: gzip, deflate Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Connection: keep-alive Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Content-Length: 0 Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Host: 10.222.0.88 Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Openstack-Api-Version: compute 2.90 Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Openstack-System-Scope: None Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: User-Agent: python-novaclient Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Auth-Token: gAAAAABi1Y2aAHZP7FhLr2puEy92y8NHUDOvUbwbXjGvLPPMybg_W_rWE0uiWZfKztu9ZtTCaqkgt6ojl48aGIdnQXLsbRG4ucJXsje7Es3qQimESYgLOF_dQ44p4LABwYH-9ioRe3nhslPypL4-9PNpVkd_2YfR5p9eFCOBX5HA7Cag0Bsrx5Q Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Domain-Id: None Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Domain-Name: None Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Identity-Status: Confirmed Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Is-Admin-Project: True Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Domain-Id: default Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Domain-Name: Default Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Name: admin Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Role: member,admin,reader Jul 18 16:43:07.614895 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Roles: member,admin,reader Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb46b30ed74742b9a95d61944ef39381", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}] Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant: admin Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant-Name: admin Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User: admin Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Domain-Id: default Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Domain-Name: Default Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Id: 264c9bf15b9849a18b942d5d77559b9b Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Name: admin Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: method: > Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: exception: Flavor 84 could not be found. Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: action_args: {'id': '84'} Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:07.616357 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:07.617841 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.618955 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-85cbfc00-3126-4fea-9c66-1146a49b1fca admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:07.620252 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-85cbfc00-3126-4fea-9c66-1146a49b1fca admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.418557 Jul 18 16:43:07.620252 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 23/44] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 16:43:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:07.627085 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-28db86d8-12a1-4331-a27a-99e92183fbd6 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:07.641309 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-28db86d8-12a1-4331-a27a-99e92183fbd6 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017820 Jul 18 16:43:07.641865 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 22/45] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 16:43:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:07.652133 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-ebc01ed1-2ed1-43db-8410-eaecbc2ca58c admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:07.666037 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-ebc01ed1-2ed1-43db-8410-eaecbc2ca58c admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017507 Jul 18 16:43:07.666593 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 24/46] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 16:43:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:07.676109 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-29d62ca7-a14b-434b-b87d-0153521754c4 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:07.682237 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.wsgi [None req-29d62ca7-a14b-434b-b87d-0153521754c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-29d62ca7-a14b-434b-b87d-0153521754c4 admin admin] Request method failure captured: Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Accept: application/json Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Accept-Encoding: gzip, deflate Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Connection: keep-alive Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Content-Length: 0 Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Host: 10.222.0.88 Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Openstack-Api-Version: compute 2.90 Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Openstack-System-Scope: None Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: User-Agent: python-novaclient Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Auth-Token: gAAAAABi1Y2aAHZP7FhLr2puEy92y8NHUDOvUbwbXjGvLPPMybg_W_rWE0uiWZfKztu9ZtTCaqkgt6ojl48aGIdnQXLsbRG4ucJXsje7Es3qQimESYgLOF_dQ44p4LABwYH-9ioRe3nhslPypL4-9PNpVkd_2YfR5p9eFCOBX5HA7Cag0Bsrx5Q Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Domain-Id: None Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Domain-Name: None Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Identity-Status: Confirmed Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Is-Admin-Project: True Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Domain-Id: default Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Domain-Name: Default Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Name: admin Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Role: member,admin,reader Jul 18 16:43:07.683744 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Roles: member,admin,reader Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb46b30ed74742b9a95d61944ef39381", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}] Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant: admin Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant-Name: admin Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User: admin Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Domain-Id: default Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Domain-Name: Default Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Id: 264c9bf15b9849a18b942d5d77559b9b Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Name: admin Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: method: > Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: exception: Flavor 84 could not be found. Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: action_args: {'id': '84'} Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:07.685322 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:07.686249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:07.687624 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-29d62ca7-a14b-434b-b87d-0153521754c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:07.688975 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-29d62ca7-a14b-434b-b87d-0153521754c4 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012621 Jul 18 16:43:07.688975 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 23/47] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 18 16:43:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:08.681713 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-ebc01ed1-2ed1-43db-8410-eaecbc2ca58c admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:08.682775 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-ebc01ed1-2ed1-43db-8410-eaecbc2ca58c admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 18 16:43:08.683171 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 25/48] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:09.213794 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-267b9880-d74d-47f1-9f05-4f6d1be1b158 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:09.219726 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.wsgi [None req-267b9880-d74d-47f1-9f05-4f6d1be1b158 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-267b9880-d74d-47f1-9f05-4f6d1be1b158 admin admin] Request method failure captured: Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Accept: application/json Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Accept-Encoding: gzip, deflate Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Connection: keep-alive Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Content-Length: 0 Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Host: 10.222.0.88 Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Openstack-Api-Version: compute 2.90 Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Openstack-System-Scope: None Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: User-Agent: python-novaclient Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Auth-Token: gAAAAABi1Y2cWPymCgdk6X7u9cDMlxFvabwdDoLbNVbzDPnK389shcL3Ub2nNMxS81UiIXjR90y92G3peECm5ZSp0qJEQBnYZ-83I7a8GTxs_mWmScXZPJOtAfJmWWEwIAqZJskyeL1PLaMOCqatGcf3XdFhZNSphHqjAf0F-zS0f0gLhE4uY4E Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Domain-Id: None Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Domain-Name: None Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Identity-Status: Confirmed Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Is-Admin-Project: True Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Domain-Id: default Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Domain-Name: Default Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Project-Name: admin Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Role: member,admin,reader Jul 18 16:43:09.221249 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Roles: member,admin,reader Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb46b30ed74742b9a95d61944ef39381", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}] Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant: admin Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-Tenant-Name: admin Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User: admin Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Domain-Id: default Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Domain-Name: Default Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Id: 264c9bf15b9849a18b942d5d77559b9b Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: X-User-Name: admin Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: method: > Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: exception: Flavor 451 could not be found. Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: action_args: {'id': '451'} Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:09.222846 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:09.223678 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.224959 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-267b9880-d74d-47f1-9f05-4f6d1be1b158 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:09.226195 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-267b9880-d74d-47f1-9f05-4f6d1be1b158 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.402826 Jul 18 16:43:09.226195 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 24/49] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 16:43:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:09.232431 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-da8c3c2a-9518-42e3-aca5-7411be45d1b0 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:09.245922 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-da8c3c2a-9518-42e3-aca5-7411be45d1b0 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016975 Jul 18 16:43:09.246462 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 26/50] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 16:43:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:09.256047 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:09.272037 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019437 Jul 18 16:43:09.272999 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 25/51] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 18 16:43:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:09.283133 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-e831c9f7-d904-419f-ab2a-e7cf497b46c3 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:09.288498 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.wsgi [None req-e831c9f7-d904-419f-ab2a-e7cf497b46c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-e831c9f7-d904-419f-ab2a-e7cf497b46c3 admin admin] Request method failure captured: Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Accept: application/json Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Accept-Encoding: gzip, deflate Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Connection: keep-alive Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Content-Length: 0 Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Host: 10.222.0.88 Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Openstack-Api-Version: compute 2.90 Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Openstack-System-Scope: None Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: User-Agent: python-novaclient Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Auth-Token: gAAAAABi1Y2cWPymCgdk6X7u9cDMlxFvabwdDoLbNVbzDPnK389shcL3Ub2nNMxS81UiIXjR90y92G3peECm5ZSp0qJEQBnYZ-83I7a8GTxs_mWmScXZPJOtAfJmWWEwIAqZJskyeL1PLaMOCqatGcf3XdFhZNSphHqjAf0F-zS0f0gLhE4uY4E Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Domain-Id: None Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Domain-Name: None Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Identity-Status: Confirmed Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Is-Admin-Project: True Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Domain-Id: default Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Domain-Name: Default Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Project-Name: admin Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Role: member,admin,reader Jul 18 16:43:09.290040 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Roles: member,admin,reader Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb46b30ed74742b9a95d61944ef39381", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb46b30ed74742b9a95d61944ef39381"}]}] Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant: admin Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant-Id: fb46b30ed74742b9a95d61944ef39381 Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-Tenant-Name: admin Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User: admin Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Domain-Id: default Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Domain-Name: Default Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Id: 264c9bf15b9849a18b942d5d77559b9b Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: X-User-Name: admin Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: method: > Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: exception: Flavor 451 could not be found. Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: action_args: {'id': '451'} Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:43:09.291503 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:09.292384 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: ERROR nova.api.openstack.wsgi Jul 18 16:43:09.293739 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-e831c9f7-d904-419f-ab2a-e7cf497b46c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:43:09.295030 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-e831c9f7-d904-419f-ab2a-e7cf497b46c3 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011981 Jul 18 16:43:09.295030 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 27/52] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 16:43:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:10.261931 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:10.262940 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 18 16:43:10.263342 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 26/53] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:10.799379 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-b9279f43-7398-4de8-ae90-13fab51817f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:10.872763 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-b9279f43-7398-4de8-ae90-13fab51817f5 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.470723 Jul 18 16:43:10.873359 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 28/54] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 18 16:43:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:11.857012 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:11.858048 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 18 16:43:11.858448 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 27/55] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:12.410999 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-84d8f445-31ea-4f39-9477-847a80f86c32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:12.487823 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-84d8f445-31ea-4f39-9477-847a80f86c32 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.492237 Jul 18 16:43:12.488297 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 29/56] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 18 16:43:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:13.466247 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:13.467235 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 18 16:43:13.467628 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 28/57] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:13.994940 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-11a78dc3-692f-47dc-9083-9da4bd124b3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:14.076066 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-11a78dc3-692f-47dc-9083-9da4bd124b3f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.472589 Jul 18 16:43:14.076610 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 30/58] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 18 16:43:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:15.159264 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:15.160268 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 18 16:43:15.160667 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 29/59] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:15.700288 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-633011de-d64d-45d4-9924-6c4a607ce5c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:43:15.787145 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-633011de-d64d-45d4-9924-6c4a607ce5c1 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.483563 Jul 18 16:43:15.787694 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 31/60] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 18 16:43:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:16.795112 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:16.796203 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 18 16:43:16.796608 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 30/61] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:17.357428 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-f8ab65b4-057f-4ef7-9c85-6340160961bc admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:17.376897 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-f8ab65b4-057f-4ef7-9c85-6340160961bc admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.441090 Jul 18 16:43:17.377438 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 32/62] 10.222.0.88 () {60 vars in 1202 bytes} [Mon Jul 18 16:43:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:10.380437 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:10.381524 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5fbfb178-8b4b-4b9c-8d9f-df1c779216e7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 18 16:44:10.381920 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 31/63] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 18 16:44:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:44:10.392437 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:10.791708 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-8b51a78c-4280-46cf-8935-ddf8f5ffad05 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:10.810847 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-8b51a78c-4280-46cf-8935-ddf8f5ffad05 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422796 Jul 18 16:44:10.811306 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 33/64] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 18 16:44:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:10.831979 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG dbcounter [-] [110232] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:10.836285 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-f3f58396-8469-41c9-a832-8d2792718e68 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:10.843802 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-f3f58396-8469-41c9-a832-8d2792718e68 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013254 Jul 18 16:44:10.847133 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 32/65] 10.222.0.88 () {60 vars in 1282 bytes} [Mon Jul 18 16:44:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:44:10.856249 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-82a9ce2d-66a6-4c9d-b04a-6b3bbc038774 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:10.864066 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-82a9ce2d-66a6-4c9d-b04a-6b3bbc038774 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011398 Jul 18 16:44:10.864597 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 34/66] 10.222.0.88 () {60 vars in 1285 bytes} [Mon Jul 18 16:44:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:10.877071 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:10.885787 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012682 Jul 18 16:44:10.886323 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 33/67] 10.222.0.88 () {60 vars in 1285 bytes} [Mon Jul 18 16:44:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:44:10.898513 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-f00c569e-06f3-40e5-8b05-d6009d1859d5 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:44:10.906417 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-f00c569e-06f3-40e5-8b05-d6009d1859d5 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012101 Jul 18 16:44:10.906941 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 35/68] 10.222.0.88 () {60 vars in 1282 bytes} [Mon Jul 18 16:44:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:52.205763 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:52.207997 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Jul 18 16:47:52.208471 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 34/69] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:52.396555 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_api:SELECT=6 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:52.572930 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-038ae9bf-ef4e-47f1-b7e8-57cbdf856acb admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:52.574079 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:52.574079 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: warnings.warn(msg) Jul 18 16:47:52.575288 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-038ae9bf-ef4e-47f1-b7e8-57cbdf856acb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:52.575752 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-038ae9bf-ef4e-47f1-b7e8-57cbdf856acb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:52.576565 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-038ae9bf-ef4e-47f1-b7e8-57cbdf856acb admin admin] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:52.577019 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-038ae9bf-ef4e-47f1-b7e8-57cbdf856acb admin admin] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:52.612045 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-038ae9bf-ef4e-47f1-b7e8-57cbdf856acb admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.216998 Jul 18 16:47:52.612607 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 36/70] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 16:47:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:47:53.444647 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:53.445754 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 18 16:47:53.446151 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 35/71] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:53.657294 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-a6431e7a-da3f-4a22-87f6-169e9db967a2 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:53.658506 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:53.658506 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: warnings.warn(msg) Jul 18 16:47:53.659616 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-a6431e7a-da3f-4a22-87f6-169e9db967a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:53.660060 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-a6431e7a-da3f-4a22-87f6-169e9db967a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:53.660851 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-a6431e7a-da3f-4a22-87f6-169e9db967a2 admin admin] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:53.661307 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-a6431e7a-da3f-4a22-87f6-169e9db967a2 admin admin] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:53.680962 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-a6431e7a-da3f-4a22-87f6-169e9db967a2 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078352 Jul 18 16:47:53.681522 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 37/72] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 16:47:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:48:05.018381 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:05.019400 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 18 16:48:05.019809 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 36/73] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:48:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:05.217087 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_cell0:SELECT=4 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:05.217740 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_cell1:SELECT=4 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:05.218366 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG dbcounter [-] [110231] Writing DB stats nova_api:SELECT=8 {{(pid=110231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:05.274159 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-0eb9baf0-12d3-458c-9e31-cc62fab6ae69 admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:05.275324 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:48:05.275324 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: warnings.warn(msg) Jul 18 16:48:05.276501 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-0eb9baf0-12d3-458c-9e31-cc62fab6ae69 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:05.276969 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-0eb9baf0-12d3-458c-9e31-cc62fab6ae69 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:05.277816 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-0eb9baf0-12d3-458c-9e31-cc62fab6ae69 admin admin] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:05.278218 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-0eb9baf0-12d3-458c-9e31-cc62fab6ae69 admin admin] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:05.303621 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-0eb9baf0-12d3-458c-9e31-cc62fab6ae69 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092285 Jul 18 16:48:05.304194 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 38/74] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 16:48:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:48:06.180751 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: DEBUG nova.api.openstack.wsgi [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] Calling method '>' {{(pid=110232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:06.181837 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: INFO nova.api.openstack.requestlog [None req-5542e790-98d3-4cdf-af7c-219e627f2438 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 18 16:48:06.182188 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: [pid: 110232|app: 0|req: 37/75] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 18 16:48:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:06.384180 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG nova.api.openstack.wsgi [None req-933eb7f0-84cc-475c-9459-eea67b4e4d4b admin admin] Calling method '>' {{(pid=110231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:06.385410 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:48:06.385410 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: warnings.warn(msg) Jul 18 16:48:06.386605 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-933eb7f0-84cc-475c-9459-eea67b4e4d4b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:06.387044 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-933eb7f0-84cc-475c-9459-eea67b4e4d4b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:06.387823 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-933eb7f0-84cc-475c-9459-eea67b4e4d4b admin admin] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:06.388264 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: DEBUG oslo_concurrency.lockutils [None req-933eb7f0-84cc-475c-9459-eea67b4e4d4b admin admin] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:06.415054 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: INFO nova.api.openstack.requestlog [None req-933eb7f0-84cc-475c-9459-eea67b4e4d4b admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091258 Jul 18 16:48:06.415629 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: [pid: 110231|app: 0|req: 39/76] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 18 16:48:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:49:06.841543 dv-cinder-846173-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 16:49:06.842093 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: Mon Jul 18 16:49:06 2022 - graceful shutdown triggered... Jul 18 16:49:06.842537 dv-cinder-846173-3-iscsi devstack@n-api.service[110232]: Gracefully killing worker 2 (pid: 110232)... Jul 18 16:49:06.842907 dv-cinder-846173-3-iscsi devstack@n-api.service[110231]: Gracefully killing worker 1 (pid: 110231)... Jul 18 16:49:07.843024 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: worker 1 buried after 1 seconds Jul 18 16:49:07.843591 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: worker 2 buried after 1 seconds Jul 18 16:49:07.843591 dv-cinder-846173-3-iscsi devstack@n-api.service[110230]: goodbye to uWSGI. Jul 18 16:49:07.844592 dv-cinder-846173-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 16:49:07.845573 dv-cinder-846173-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 16:49:07.848480 dv-cinder-846173-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 16:49:07.858185 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:49:07 2022] *** Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: nodename: dv-cinder-846173-3-iscsi Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: machine: x86_64 Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: clock source: unix Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: pcre jit disabled Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: detected number of CPU cores: 4 Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: current working directory: / Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: your processes number limit is 47680 Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: your memory page size is 4096 bytes Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: detected max file descriptor number: 2048 Jul 18 16:49:07.862699 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: lock engine: pthread robust mutexes Jul 18 16:49:07.863702 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: thunder lock: enabled Jul 18 16:49:07.863702 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 16:49:07.863702 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:49:07.904125 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: Python main interpreter initialized at 0x5626a73049c0 Jul 18 16:49:07.904125 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: python threads support enabled Jul 18 16:49:07.904125 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: your server socket listen backlog is limited to 100 connections Jul 18 16:49:07.904125 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:49:07.904539 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:49:07.904539 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: *** Operational MODE: preforking *** Jul 18 16:49:07.906443 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:49:07.906443 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: spawned uWSGI master process (pid: 124738) Jul 18 16:49:07.905065 dv-cinder-846173-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 16:49:07.908352 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: spawned uWSGI worker 1 (pid: 124753, cores: 1) Jul 18 16:49:07.908352 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: spawned uWSGI worker 2 (pid: 124754, cores: 1) Jul 18 16:49:07.908352 dv-cinder-846173-3-iscsi devstack@n-api.service[124738]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:49:08.609218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:49:08.625732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:49:09.810231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:49:09.810231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: from cryptography.utils import int_from_bytes Jul 18 16:49:09.810869 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:49:09.810869 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: from cryptography.utils import int_from_bytes Jul 18 16:49:09.887063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:49:09.887063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: from cryptography.utils import int_from_bytes Jul 18 16:49:09.887638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:49:09.887638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: from cryptography.utils import int_from_bytes Jul 18 16:49:12.295837 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:49:12.296691 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:49:12.296691 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:49:12.297278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:49:12.297478 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:49:12.297757 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.298089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.298363 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.298696 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.299035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.300376 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.300836 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.301056 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.301397 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.301666 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.301990 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.302452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-3-iscsi {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.303208 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.303527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.303847 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.304173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.304489 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.304821 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.305159 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.305714 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.308041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.308041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.308041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.308041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.308041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.308041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.308041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.309598 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.309598 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.309598 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.309598 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-3-iscsi {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.310108 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.310108 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.310785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.310785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.311245 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.311473 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.311923 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.312145 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.312382 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.312634 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.312995 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.313315 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.313646 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.313960 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.314269 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.314612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.314911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.315406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.315586 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.315776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.317035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.317035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.317035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.317585 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.317585 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.317585 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.319286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.319286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.319286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.320556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.320556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.320556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.320556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.320556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.321869 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.322204 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.322538 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.322863 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.323196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.323513 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.323841 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.324265 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.324521 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.324837 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.325241 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.325557 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.325871 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.326196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.326527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.326844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.327160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.327478 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.327805 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.328147 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.328512 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.328715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.329033 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.329352 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.329675 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.330027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.330332 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.330589 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.330894 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.331210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.331525 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.331838 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.332152 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.332465 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.332774 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.333162 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.333446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.333781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.334115 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.334441 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.334755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.335069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.335413 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.335679 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.335997 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.336308 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.337549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.337549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.337549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.338163 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.338163 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.338753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.338753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.339235 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.339235 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.340673 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.340673 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.340673 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.340673 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.341622 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.342203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.342530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.342844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.343155 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.343498 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.343775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.344105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.344438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.344739 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.345104 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.345420 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.345778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.346093 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.346432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.346784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.347108 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.347451 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.347789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.348114 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.348432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.348755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.349112 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.349473 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.349790 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.350105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.350807 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.350807 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.352467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.352467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.352467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.352467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.354914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.354914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.354914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.354914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.354914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.354914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.354914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.357766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.357766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.357766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.357766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.357766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.357766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.357766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.357766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.359447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.359447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.359447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.359447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.359447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.359447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.361157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.361157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.361157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.361157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.361781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.361781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.362355 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.362674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.362989 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.363303 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.363616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.363930 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.364248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.364559 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.365531 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.365777 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.366096 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.366440 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.366873 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.367037 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.367358 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.367687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.368100 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.368314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.369545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.369545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.369545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.369545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.372253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.372253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.372253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.372253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.372253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.372253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.372253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.372253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.374742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.374742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.374742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.374742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.374742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.374742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.374742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.374742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.375986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.376131 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:49:12.376625 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.376625 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.377065 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:49:12.377231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.377231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.377539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:49:12.377686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.377686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.378047 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:49:12.378205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.378359 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:49:12.378506 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.378506 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.378918 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.379071 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.379071 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.379375 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.379530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.379530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.379822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.379965 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.379965 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.380253 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.380409 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.380565 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.381304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.381304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.381598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.382463 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.382742 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.382983 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.382983 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.383451 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.383698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.383967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.384455 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.384455 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.384857 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.385085 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.385234 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.385379 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.385379 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.385681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-3-iscsi {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.385855 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.385855 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.386248 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.386402 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.386402 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.386800 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.386961 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.386961 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.387397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.387555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.387555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.387833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.387990 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.387990 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.388281 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.388440 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.388586 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.388874 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.388874 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.389217 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.389372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.389372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.389372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.389853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.390039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.390039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.390341 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.390500 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.390500 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.390790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.390934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.390934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.391225 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.391377 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.391523 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.391674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.391846 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.392333 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.392517 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.392517 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.392974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.393134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.393134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.393437 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.393591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.393745 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.393941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.394092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.394447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.394618 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.394764 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.394998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.395152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.395459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-3-iscsi {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.395796 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.395949 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.396124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.396394 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.396554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.396698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.396842 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.397060 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.397229 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.397486 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.397648 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.397802 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.397947 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.398105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.398259 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.398405 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.398559 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.398746 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.398981 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.399247 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.399506 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.399747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.399982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.400224 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.400530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.400756 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.401090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.401335 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.401574 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.401796 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.401963 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.402133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.402615 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.402790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.403065 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.403236 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.403400 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.403555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.403555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.403850 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.404004 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.404150 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.404315 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.404315 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.404749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.405047 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.405047 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.405354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.408509 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.408698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.408856 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.409997 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.410170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.410343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.410504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.410654 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.410820 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.410991 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.410991 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.410991 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.411427 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.411573 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.411573 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.412413 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.412856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.412856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.413519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.413678 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.413678 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.413977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.414133 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.414292 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.414439 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.414439 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.414713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.415014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.415014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.415318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.415472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.415472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.417117 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.417214 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.417214 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.417860 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.417958 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.417958 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.418139 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.418227 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.418301 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.418370 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.418370 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.418506 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.418576 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.418658 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.418756 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.418756 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.418946 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.419027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.419233 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.419419 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419505 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.419505 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.419681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419763 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.419848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.419848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.420290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.420511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.420924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.421110 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.421547 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.421887 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.422219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.422406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.422596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.422976 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.423143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.423320 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.423647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.423811 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.423959 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.424109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.424253 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.424397 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.424553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.424699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.424856 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.425225 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.425379 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.425524 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.425681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.425827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.426033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.426184 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.426338 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.426483 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.426642 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.426797 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.426951 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.427109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.427255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.427407 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.427623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.427776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.428681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.428966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.429133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.429299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.429447 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.429599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.429754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.429901 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.430057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.430201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.430354 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.430499 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.430657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.430803 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.430957 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.431118 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.431388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.431550 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.431783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.431783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.432092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.432289 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.432461 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.432608 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.432766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.433292 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.433551 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.433953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.434188 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.434445 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.434664 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.434827 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.435006 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.435202 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.435541 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.435709 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.435866 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.436020 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.436168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.436311 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.436462 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.436623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.436768 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.436954 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.437116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.437116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.437116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.437553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.437700 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.437851 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.437996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.437996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.438305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.438452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.438452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.438950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.439105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.439105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.439395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.439599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.439599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.439878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.440029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.440029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.440314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.440459 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.440459 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.440739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:49:12.440905 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.440905 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.441203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.441387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.441387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.441780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.441934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.441934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.442234 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.442386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.442386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.442673 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.442823 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.442823 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.443344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.443508 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.443508 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.443828 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.444111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.444111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.444420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.444573 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.444573 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.444872 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.445074 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.445242 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.445402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.445572 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.445835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.446013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.446181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.446334 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.446486 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.446646 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.446797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.446956 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.447290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.447634 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.447933 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.448094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.448246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.448417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.448595 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.448776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.449131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.449293 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.449453 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.449627 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.449790 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.449950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.450110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.450261 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.450420 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.450582 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.450749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.450901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.451053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.451211 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.451363 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.451528 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.451789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.451949 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.452109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.452261 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.452413 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.452576 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.452736 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.452930 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.453089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.453279 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.453616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.453780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.453935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.454114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.454384 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.454549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.454717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.454880 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.455041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.455194 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.455365 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.455526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.455687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.455871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.456145 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.456304 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.456455 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.456607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.456779 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.457016 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.457178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.457384 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.457560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.457725 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.457887 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.458094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.458255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.458414 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.458577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.458779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.458939 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.459291 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.459468 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.459622 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.459783 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.459957 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.460110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.460271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.460424 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.460584 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.460786 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.460977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.461136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.461307 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.461467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.461620 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.461791 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.462050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.462293 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.462460 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.462633 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.462843 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.463053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.463299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.463816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.464073 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.464317 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.464989 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.465202 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.465426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.465426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.465426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.465426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.465426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.465426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.465426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.466710 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.466865 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.467025 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.467325 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.467501 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.467501 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.467501 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.467965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.468294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.468294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.468647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.468802 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.468802 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.469467 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.469632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.469632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.469943 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.470096 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.470096 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.470396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.470560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.470725 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.471848 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.471848 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.472364 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.472536 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.472536 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.472839 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.473020 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.473020 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.473340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.473510 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.473894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.474066 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.474066 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.474898 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.475207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.475207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.475207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.475659 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.475812 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.475974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.476136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.476136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.476445 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.476736 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.476736 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.482278 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.482579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.482579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.482890 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.483048 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.483048 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.483442 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.483776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484062 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484234 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484234 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484572 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484964 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484964 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484964 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.484964 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486003 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486145 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486342 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486428 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486521 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486781 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486885 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.486963 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487200 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487282 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487361 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487441 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487441 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487734 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487804 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487902 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.487996 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.488096 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.488185 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.488309 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.488409 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.488491 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.488571 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.488693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.488693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489071 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489366 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489466 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489639 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489826 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.489911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.491135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.491274 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.491389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.491508 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.491738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.491738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.491978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.492092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.492204 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.492316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.492427 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.492566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.492789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.492945 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.493073 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.493187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.497691 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.497834 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.497953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498229 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498384 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498477 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498660 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498841 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.498954 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499202 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499296 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499664 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.499907 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500473 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500644 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500829 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.500961 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501040 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501126 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501313 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501736 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501845 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.501943 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502030 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502225 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502225 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502653 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502853 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.502940 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503186 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503280 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503280 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503444 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.503876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504062 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504328 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504415 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504415 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504575 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504667 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504667 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.504939 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505040 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505288 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.505937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506067 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506302 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506610 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506704 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506882 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506882 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.506882 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.507163 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.507248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.507248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.507507 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.507649 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.507856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.508037 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.508170 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.508435 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.508595 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.508745 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.509358 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.510845 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.510940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511112 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511185 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511256 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511333 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511405 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511558 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511777 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.511856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.512612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.512710 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.512793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.512873 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.512988 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.513076 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.513157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.513240 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.513643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.513747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.513828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.513981 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.514294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.514533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.514644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.514872 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.514985 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.515221 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.515329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.515558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.515670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.515886 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.515991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.516211 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.516331 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.516534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.516675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.516848 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.516997 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.517223 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.517381 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.517542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.517765 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.517892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.518100 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.518222 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.518432 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.518587 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.518766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.518859 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.519279 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.519400 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.519483 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.519563 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.519757 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.519898 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.520094 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.520404 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.520501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.520728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.520825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.521189 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.521348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.521538 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.521728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.521887 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.522044 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.522217 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.522365 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.522598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.522748 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.522944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.523105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.523252 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.523353 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.523591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.523741 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.523906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.524107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.524261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.524448 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.524596 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.524852 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.525057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.525205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.525395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.525535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.525720 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.525852 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.526042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.526164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.526363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.526490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.526689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.526805 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.527009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.527337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.527440 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.527654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.527757 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.528001 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.528099 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.528334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.528440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.528716 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.528852 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.529106 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.529378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.529544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.529709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.530007 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.530178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.530326 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.530647 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.530790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.531011 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.531108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.531325 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.531482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.531621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.531789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.531951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.532112 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.532265 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.532432 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.532586 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.532754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.533029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.533188 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.533334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.533441 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.533529 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.533727 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.533830 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.534050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.534505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.534871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.534983 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.535172 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.535266 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.535492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.535584 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.535813 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.535926 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.536133 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.536231 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.536446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.536537 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.536759 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.537698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.537787 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.537860 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.537938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.538012 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.538243 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.538350 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.538557 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.538646 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.538878 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.538967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.539192 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.539283 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.539518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.539619 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.539920 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.540037 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.540232 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.540333 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.540500 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.540588 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.540756 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.540857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.541107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.541192 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.541910 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.542010 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.542093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.542174 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.542255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.542525 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.542885 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.543210 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.543303 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.543523 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.543776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.543871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.544118 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.544219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.544445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.544581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.544788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.544918 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.545206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.545538 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.545862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.546072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.546201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.546406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.546567 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.546728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.546855 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.547050 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.547150 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.547388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.547582 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.547716 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.547839 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.548065 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.548183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.548390 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.548511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.548708 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.548811 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.549054 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.549203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.549372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.549569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.549709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.549985 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.550116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.550295 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.550525 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.550616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.550912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.551084 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.551235 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.551547 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.551648 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.551870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.552008 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.552263 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.552371 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.553156 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.553372 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.553565 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.553803 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.554916 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.555130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.555265 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.555386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.555530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.555743 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.555934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.556133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.556313 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.556485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.556615 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.556832 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.556974 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.557121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.557260 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.557403 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.557533 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.557827 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.558052 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.558206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.558346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.558476 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.558738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.558870 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.558997 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.559930 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560027 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560121 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560253 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560356 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560449 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560625 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.560858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.561126 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.561246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.561448 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.561589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.561760 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.561866 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.562069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.562163 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.562400 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.562512 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.562708 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.562809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.563023 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.563123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.563333 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.563509 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.563641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.563768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.563956 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.564093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.564265 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.564417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.564574 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.564739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.564946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.565088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.565241 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.565413 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.565509 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.565740 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.565841 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.566068 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.566175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.566392 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.566484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.566702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.566794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.567012 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.567118 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.567322 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.567413 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.567635 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.567728 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.567944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.568058 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.568461 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.568647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.568898 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.569034 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.569392 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.569522 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.569718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.569847 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.570074 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.570198 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.570471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.570585 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.570703 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.570813 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.570976 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.571105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.571429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.571564 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.571795 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.571919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.572068 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.572186 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.572397 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.572519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.572727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.573449 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.573623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.573800 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.573953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.574110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.574110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.574430 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.574612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.574773 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.574923 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.575072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.575227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.575393 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.575592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.575771 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.575931 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.576083 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.576239 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.576390 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.576539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.576734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.576926 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.577100 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.577290 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.577516 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.577733 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.577831 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.577903 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.578054 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.578183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.578386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.578577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.578709 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.578805 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.579006 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.579112 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.579342 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.579456 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.579657 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.579749 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.579975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.580075 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.580296 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.580395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.580616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.580708 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.580968 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.581095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.581284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.581473 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.581601 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.581801 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.581937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.582175 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.582313 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.582461 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.582562 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.582781 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.582874 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.583118 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.583270 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.583677 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.583789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.583874 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.583964 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.584145 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.584239 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.584425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.584540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.584763 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.584853 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.585113 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.585208 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.585443 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.585535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.585725 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:49:12.585867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.586082 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.586460 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.586749 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.587144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.587586 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.587925 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.588251 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.588588 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.589033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.589355 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.589939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.590265 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.590582 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.590901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.591236 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.591554 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.591879 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.592211 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.592523 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.592837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.593270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.593694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.594143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.594729 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.595314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.595774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.596129 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.596463 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.596806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.597167 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.597497 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.597822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.598153 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.598514 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.598944 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.599152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.600077 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.600411 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.600738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.601114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.601460 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.601791 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.602125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.602466 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.602785 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.603103 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.603427 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.603889 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.604060 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.604379 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.604700 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.605042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.605412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.605899 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.606004 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.606310 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.606643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.606964 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.607682 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.607682 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.607906 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.608264 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.608581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.608971 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.609312 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.609648 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.609993 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.610318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.610653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.610983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.611312 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.611640 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.611967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.612295 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.612622 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.613005 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.613322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.613651 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.613978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.614306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.614904 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.615814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.616242 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.616573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.617194 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.617812 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.618355 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.618756 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.619336 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.619831 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.620171 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.620539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.620931 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.621561 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.622207 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.622830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.623181 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.623522 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.623862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.624528 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.624652 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.624926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.625266 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.625605 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.626231 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.626393 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.626589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.627783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.627783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.627783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.629445 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.630233 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.630698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.631243 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.631826 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.632868 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.633653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.634070 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.634766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.635453 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.635875 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.636305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.636721 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.637254 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.637569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.637999 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.638421 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.639059 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.639457 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.639861 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.640510 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.641033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.641415 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.643127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.644047 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.645275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.645965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.646919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.647589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.648036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.648463 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.649162 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.649576 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.649977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.650646 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.651101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.651495 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.651902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.652306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.652700 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.653131 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.653552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.654138 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.654554 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.655199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.655695 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.656830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.656830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.656830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.657436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.657837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.658308 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.658635 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.659216 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.659549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.659883 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.660234 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.660806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.661223 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.661557 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.662411 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.665492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.665492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.665492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.665492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.665492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.665492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.665492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.666911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.666911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.666911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.667336 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.668117 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.669645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.670351 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.671199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.671886 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.672380 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.672780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.673223 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.673624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.674184 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.675195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.675689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.676107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.676481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.677118 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.678412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.678412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.679034 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.679592 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.679989 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.680417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.681094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.682080 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.682080 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.682494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.683043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.683447 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.683853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.684257 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.684739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.685589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.685994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.686600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.686819 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.687254 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.687900 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.687900 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.688416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.688870 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.689239 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.689724 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.690056 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.690393 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.691739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.692318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.692950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.693568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.693949 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.694549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.695314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.695921 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.696324 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.696825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.697036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.697378 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.697718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.698046 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.698464 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.698788 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.699256 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.699771 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.700095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.700413 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.700739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.701084 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.701686 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.702010 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.702363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.702641 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.703079 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.703420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.703769 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.704090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.704734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.705093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.705889 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.706217 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.706574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.706987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.707320 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.707702 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.708036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.708370 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.708693 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.709290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.709821 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.710184 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.710526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.710932 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.711264 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.712386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.712730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.713694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.714048 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.715513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.723120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.723120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.723120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.723120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.723120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.723120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.723120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.723120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.724299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.724299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.724299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.724299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.724299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.724299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.724299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.724299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.726182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.726182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.726182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.726182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.726182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.726182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.726182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.726182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.727519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.727519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.727519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.727519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.728110 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.728262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.728474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:49:12.728710 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:49:12.756840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO dbcounter [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Registered counter for database nova_api Jul 18 16:49:12.785932 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_db.sqlalchemy.engines [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:49:12.796481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writer thread running {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:49:12.866392 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.context [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6070aaf7-16bd-4fe0-b966-c841d36d60dc(cell1) {{(pid=124754) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:49:12.870464 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:12.872069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:12.872916 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:12.875827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:12.878067 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO dbcounter [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Registered counter for database nova_cell0 Jul 18 16:49:12.882846 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO dbcounter [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Registered counter for database nova_cell1 Jul 18 16:49:12.890961 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_db.sqlalchemy.engines [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:49:12.895930 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO dbcounter [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Registered counter for database nova_api Jul 18 16:49:12.897589 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writer thread running {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:49:12.898359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_db.sqlalchemy.engines [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:49:12.920273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_db.sqlalchemy.engines [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:49:12.927519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writer thread running {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:49:12.990390 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.context [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6070aaf7-16bd-4fe0-b966-c841d36d60dc(cell1) {{(pid=124753) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:49:12.994459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:12.997096 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:12.997096 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:12.998886 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:13.001631 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO dbcounter [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Registered counter for database nova_cell0 Jul 18 16:49:13.006420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO dbcounter [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Registered counter for database nova_cell1 Jul 18 16:49:13.014163 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_db.sqlalchemy.engines [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:49:13.016021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_db.sqlalchemy.engines [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:49:13.026256 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writer thread running {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:49:13.027790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writer thread running {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:49:13.078108 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writer thread running {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:49:13.087722 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO dbcounter [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Registered counter for database nova_cell0 Jul 18 16:49:13.096601 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_db.sqlalchemy.engines [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:49:13.102933 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writer thread running {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:49:13.213470 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO dbcounter [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Registered counter for database nova_cell0 Jul 18 16:49:13.220633 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_db.sqlalchemy.engines [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:49:13.226169 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writer thread running {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:49:13.458638 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: WARNING keystonemiddleware.auth_token [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:49:13.466237 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: WARNING keystonemiddleware.auth_token [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:49:13.579360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: WARNING keystonemiddleware.auth_token [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:49:13.587759 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: WARNING keystonemiddleware.auth_token [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:49:13.853553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: WARNING keystonemiddleware.auth_token [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:49:13.864324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: WARNING keystonemiddleware.auth_token [None req-92c4c0cf-65de-4fde-a3f1-328d045f1a69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:49:13.870628 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626a73049c0 pid: 124754 (default app) Jul 18 16:49:13.997013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: WARNING keystonemiddleware.auth_token [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:49:14.004079 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: WARNING keystonemiddleware.auth_token [None req-b37ad95a-0ba0-44d4-909d-3295ebd80add None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:49:14.010764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5626a73049c0 pid: 124753 (default app) Jul 18 16:49:54.485966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:54.490472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:54.490472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:54.490472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:56.100703 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-086bbe49-aed7-41e4-90d9-078d009b94b8 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Action: 'create', calling method: .version_select at 0x7fd4f7225820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-541898781", "metadata": {"Type": "work"}}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-086bbe49-aed7-41e4-90d9-078d009b94b8 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Request method failure captured: Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 121 Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y8ya202dS6JSyQw75LeqPdVo1dYz8kHy8g2g8qkiR5i2ColibE9W3qDj14csC2Z2QutdNO-0yImr3qn2Oi7XlVCwiKtuhZO-hNU2KAbT7F8bQ8X0MRsEn5y4b2vreUlk6eXyaeGzI4BD1uxG2r1SO7I2AkDLGJF8um-VRIi7GKsLH0 Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:49:56.116319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_67975f78146c41a9aecc4f09f993f6bc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}] Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 4f6db5c6b0b64503afc740f5c4748ad1 Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-541898781", "metadata": {"Type": "work"}}} Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: Jul 18 16:49:56.118081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-541898781', 'metadata': {'Type': 'work'}}}} Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:49:56.119201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:49:56.129816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:49:56.131827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:49:56.131827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.131827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-086bbe49-aed7-41e4-90d9-078d009b94b8 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:49:56.131827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-086bbe49-aed7-41e4-90d9-078d009b94b8 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.646786 Jul 18 16:49:56.131827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 1/1] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 18 16:49:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1650 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:49:56.140009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=3 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:56.140873 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=3 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:56.142040 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=3 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:56.142842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=3 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:56.355929 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d696ccb4-a4ec-4d82-9c75-6216fffea421 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Action: 'create', calling method: .version_select at 0x7fd4f7272430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1394361256", "metadata": {"Type": "work"}}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d696ccb4-a4ec-4d82-9c75-6216fffea421 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Request method failure captured: Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 120 Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y8ya202dS6JSyQw75LeqPdVo1dYz8kHy8g2g8qkiR5i2ColibE9W3qDj14csC2Z2QutdNO-0yImr3qn2Oi7XlVCwiKtuhZO-hNU2KAbT7F8bQ8X0MRsEn5y4b2vreUlk6eXyaeGzI4BD1uxG2r1SO7I2AkDLGJF8um-VRIi7GKsLH0 Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:49:56.359897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_67975f78146c41a9aecc4f09f993f6bc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}] Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 4f6db5c6b0b64503afc740f5c4748ad1 Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1394361256", "metadata": {"Type": "work"}}} Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: Jul 18 16:49:56.361485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1394361256', 'metadata': {'Type': 'work'}}}} Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi '0' Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:49:56.362544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:49:56.364114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:49:56.366352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:49:56.366352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.366352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d696ccb4-a4ec-4d82-9c75-6216fffea421 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:49:56.366352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d696ccb4-a4ec-4d82-9c75-6216fffea421 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.228202 Jul 18 16:49:56.366352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 1/2] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 18 16:49:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:49:56.372154 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-010a92d4-02ad-4306-bf6c-cf4e415196cc tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Action: 'create', calling method: .version_select at 0x7fd4f71adb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1910917751", "metadata": {"Type": "work"}}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-010a92d4-02ad-4306-bf6c-cf4e415196cc tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Request method failure captured: Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 119 Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y8ya202dS6JSyQw75LeqPdVo1dYz8kHy8g2g8qkiR5i2ColibE9W3qDj14csC2Z2QutdNO-0yImr3qn2Oi7XlVCwiKtuhZO-hNU2KAbT7F8bQ8X0MRsEn5y4b2vreUlk6eXyaeGzI4BD1uxG2r1SO7I2AkDLGJF8um-VRIi7GKsLH0 Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:49:56.374828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_67975f78146c41a9aecc4f09f993f6bc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}] Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 4f6db5c6b0b64503afc740f5c4748ad1 Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1910917751", "metadata": {"Type": "work"}}} Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: Jul 18 16:49:56.379401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1910917751', 'metadata': {'Type': 'work'}}}} Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi '' Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:49:56.380998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:49:56.383069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:49:56.385330 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:49:56.385330 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:49:56.385330 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-010a92d4-02ad-4306-bf6c-cf4e415196cc tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:49:56.385330 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-010a92d4-02ad-4306-bf6c-cf4e415196cc tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008067 Jul 18 16:49:56.385330 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 2/3] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 18 16:49:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:49:56.389351 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bef7eea6-f652-48ad-8621-1f4016001fc1 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Calling method '.version_select at 0x7fd4f7255790>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:58.201980 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3e086be4-0317-4b3a-ba44-769d43d0e138 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Action: 'create', calling method: .version_select at 0x7fd4f7ad3b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-990400677", "metadata": {"Type": "work"}}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:58.394524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-bef7eea6-f652-48ad-8621-1f4016001fc1 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] HTTP exception thrown: Volume tempest-invalid-788903146 could not be found. Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bef7eea6-f652-48ad-8621-1f4016001fc1 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Request method failure captured: Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-788903146 HTTP/1.1 Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y8ya202dS6JSyQw75LeqPdVo1dYz8kHy8g2g8qkiR5i2ColibE9W3qDj14csC2Z2QutdNO-0yImr3qn2Oi7XlVCwiKtuhZO-hNU2KAbT7F8bQ8X0MRsEn5y4b2vreUlk6eXyaeGzI4BD1uxG2r1SO7I2AkDLGJF8um-VRIi7GKsLH0 Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:49:58.399003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_67975f78146c41a9aecc4f09f993f6bc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}] Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 4f6db5c6b0b64503afc740f5c4748ad1 Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Volume tempest-invalid-788903146 could not be found. Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': 'tempest-invalid-788903146'} Jul 18 16:49:58.401990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-788903146 could not be found. (HTTP 404) (Request-ID: req-628e81d1-f31b-4c92-98ff-58025be0e725) Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.410246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:49:58.411665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-788903146 could not be found. Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:49:58.413036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-788903146 could not be found. Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-788903146 could not be found. Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bef7eea6-f652-48ad-8621-1f4016001fc1 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Returning 404 to user: Volume tempest-invalid-788903146 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bef7eea6-f652-48ad-8621-1f4016001fc1 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/tempest-invalid-788903146" status: 404 len: 98 microversion: 2.1 time: 2.016424 Jul 18 16:49:58.414662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 2/4] 10.222.0.88 () {58 vars in 1214 bytes} [Mon Jul 18 16:49:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-788903146 => generated 98 bytes in 2019 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:49:58.415784 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-50fb93da-7bbb-4d2e-994b-376ab8a54ffb tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005569 Jul 18 16:49:58.420871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 3/5] 10.222.0.88 () {58 vars in 1139 bytes} [Mon Jul 18 16:49:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 18 16:49:58.433529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-453a2984-df40-4fca-9c7f-d46edfa26fd4 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005017 Jul 18 16:49:58.437022 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 4/6] 10.222.0.88 () {58 vars in 1136 bytes} [Mon Jul 18 16:49:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 18 16:49:58.452112 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-61286073-3b90-48e4-bdcf-a926a2fb4f58 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Calling method '.version_select at 0x7fd4f72553a0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:58.489442 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-61286073-3b90-48e4-bdcf-a926a2fb4f58 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] HTTP exception thrown: Volume 6de25b4a-be53-430d-839b-3b4ec419733b could not be found. Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-61286073-3b90-48e4-bdcf-a926a2fb4f58 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Request method failure captured: Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/os-volumes/6de25b4a-be53-430d-839b-3b4ec419733b HTTP/1.1 Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y8ya202dS6JSyQw75LeqPdVo1dYz8kHy8g2g8qkiR5i2ColibE9W3qDj14csC2Z2QutdNO-0yImr3qn2Oi7XlVCwiKtuhZO-hNU2KAbT7F8bQ8X0MRsEn5y4b2vreUlk6eXyaeGzI4BD1uxG2r1SO7I2AkDLGJF8um-VRIi7GKsLH0 Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:49:58.491770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_67975f78146c41a9aecc4f09f993f6bc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}] Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 4f6db5c6b0b64503afc740f5c4748ad1 Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Volume 6de25b4a-be53-430d-839b-3b4ec419733b could not be found. Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '6de25b4a-be53-430d-839b-3b4ec419733b'} Jul 18 16:49:58.494480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6de25b4a-be53-430d-839b-3b4ec419733b could not be found. (HTTP 404) (Request-ID: req-59c38190-2184-476e-8d97-ee880cdccd52) Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.495436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:49:58.496814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6de25b4a-be53-430d-839b-3b4ec419733b could not be found. Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:49:58.498560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6de25b4a-be53-430d-839b-3b4ec419733b could not be found. Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6de25b4a-be53-430d-839b-3b4ec419733b could not be found. Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-61286073-3b90-48e4-bdcf-a926a2fb4f58 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Returning 404 to user: Volume 6de25b4a-be53-430d-839b-3b4ec419733b could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-61286073-3b90-48e4-bdcf-a926a2fb4f58 tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/6de25b4a-be53-430d-839b-3b4ec419733b" status: 404 len: 109 microversion: 2.1 time: 0.046221 Jul 18 16:49:58.500850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 5/7] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 16:49:58 2022] DELETE /compute/v2.1/os-volumes/6de25b4a-be53-430d-839b-3b4ec419733b => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:49:58.510557 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-511bf349-d50e-4d63-af91-a47eb3f1092e tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Calling method '.version_select at 0x7fd4f7077af0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:58.561779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-511bf349-d50e-4d63-af91-a47eb3f1092e tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] HTTP exception thrown: Volume 9b319994-36e3-497f-9c16-e35c7be2521a could not be found. Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-511bf349-d50e-4d63-af91-a47eb3f1092e tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Request method failure captured: Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/os-volumes/9b319994-36e3-497f-9c16-e35c7be2521a HTTP/1.1 Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y8ya202dS6JSyQw75LeqPdVo1dYz8kHy8g2g8qkiR5i2ColibE9W3qDj14csC2Z2QutdNO-0yImr3qn2Oi7XlVCwiKtuhZO-hNU2KAbT7F8bQ8X0MRsEn5y4b2vreUlk6eXyaeGzI4BD1uxG2r1SO7I2AkDLGJF8um-VRIi7GKsLH0 Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:49:58.563977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_67975f78146c41a9aecc4f09f993f6bc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67975f78146c41a9aecc4f09f993f6bc"}]}] Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 67975f78146c41a9aecc4f09f993f6bc Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesNegativeTest-1111397138 Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 4f6db5c6b0b64503afc740f5c4748ad1 Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesNegativeTest-1111397138-project Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Volume 9b319994-36e3-497f-9c16-e35c7be2521a could not be found. Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '9b319994-36e3-497f-9c16-e35c7be2521a'} Jul 18 16:49:58.565574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b319994-36e3-497f-9c16-e35c7be2521a could not be found. (HTTP 404) (Request-ID: req-0be78e57-e9c3-434b-8391-2d6a2aeee29f) Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.566452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:49:58.568417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b319994-36e3-497f-9c16-e35c7be2521a could not be found. Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:49:58.569987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b319994-36e3-497f-9c16-e35c7be2521a could not be found. Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b319994-36e3-497f-9c16-e35c7be2521a could not be found. Jul 18 16:49:58.571962 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:49:58.575972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-511bf349-d50e-4d63-af91-a47eb3f1092e tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] Returning 404 to user: Volume 9b319994-36e3-497f-9c16-e35c7be2521a could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:49:58.575972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-511bf349-d50e-4d63-af91-a47eb3f1092e tempest-VolumesNegativeTest-1111397138 tempest-VolumesNegativeTest-1111397138-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/9b319994-36e3-497f-9c16-e35c7be2521a" status: 404 len: 109 microversion: 2.1 time: 0.072009 Jul 18 16:49:58.575972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 6/8] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:49:58 2022] GET /compute/v2.1/os-volumes/9b319994-36e3-497f-9c16-e35c7be2521a => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:50:00.162643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3e086be4-0317-4b3a-ba44-769d43d0e138 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.635336 Jul 18 16:50:00.176069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a5205fa7-f1fd-4e6e-ba43-385881ba5f8e tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Calling method '.version_select at 0x7fd4f70cdd30>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:00.177250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 3/9] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 18 16:49:57 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2651 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 16:50:00.356492 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5c15d52c-2abf-4224-a7f2-1e8815edaf39 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f70b91f0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:00.460347 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a5205fa7-f1fd-4e6e-ba43-385881ba5f8e tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e" status: 200 len: 352 microversion: 2.1 time: 0.287444 Jul 18 16:50:00.462377 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 7/10] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:50:00 2022] GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e => generated 352 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:00.529090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5c15d52c-2abf-4224-a7f2-1e8815edaf39 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/a1b41c38-640c-40e5-874c-be36f44393e5" status: 200 len: 351 microversion: 2.1 time: 0.177368 Jul 18 16:50:00.530501 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 4/11] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:50:00 2022] GET /compute/v2.1/os-volumes/a1b41c38-640c-40e5-874c-be36f44393e5 => generated 351 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:01.485010 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1ee6d7fb-27e3-4a2a-9aa9-7bb1edec6233 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Calling method '.version_select at 0x7fd4f70778b0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:01.733433 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1ee6d7fb-27e3-4a2a-9aa9-7bb1edec6233 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e" status: 200 len: 353 microversion: 2.1 time: 0.253485 Jul 18 16:50:01.735020 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 8/12] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:50:01 2022] GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e => generated 353 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:01.748110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-11decef8-bc2c-42fb-b571-d6960fb41703 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Calling method '.version_select at 0x7fd4f70b9940>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:01.852437 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-11decef8-bc2c-42fb-b571-d6960fb41703 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e" status: 200 len: 353 microversion: 2.1 time: 0.109151 Jul 18 16:50:01.853360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 5/13] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:50:01 2022] GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:01.875630 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b5e667e6-83be-4257-8f9a-418386aaaa90 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Calling method '.version_select at 0x7fd4f708b0d0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:02.948049 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b5e667e6-83be-4257-8f9a-418386aaaa90 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e" status: 202 len: 0 microversion: 2.1 time: 1.077935 Jul 18 16:50:02.962393 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-02071a42-fe10-459d-8d69-dbf2d756a9a8 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Calling method '.version_select at 0x7fd4f70b9a60>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:02.968443 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 9/14] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 16:50:01 2022] DELETE /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:50:03.147551 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-02071a42-fe10-459d-8d69-dbf2d756a9a8 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e" status: 200 len: 352 microversion: 2.1 time: 0.189132 Jul 18 16:50:03.148412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 6/15] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:50:02 2022] GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e => generated 352 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:04.167689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-db9dd893-b713-4c03-a14a-fd5172b2f024 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Calling method '.version_select at 0x7fd4f7255280>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:04.221412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8862aa9b-7220-4e7e-8bcf-2e7fc468233c tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f70b9430>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:04.325208 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8862aa9b-7220-4e7e-8bcf-2e7fc468233c tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/829cdd67-6dc0-42ca-985e-dc428ef68ecd" status: 200 len: 350 microversion: 2.1 time: 0.107754 Jul 18 16:50:04.327027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 7/16] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:50:04 2022] GET /compute/v2.1/os-volumes/829cdd67-6dc0-42ca-985e-dc428ef68ecd => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:04.609128 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-db9dd893-b713-4c03-a14a-fd5172b2f024 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] HTTP exception thrown: Volume 19030dbf-81c9-4cb4-aa54-b40551c3c64e could not be found. Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-db9dd893-b713-4c03-a14a-fd5172b2f024 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Request method failure captured: Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e HTTP/1.1 Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y81FsixG2aioUz4tRwygy_s6wqR4aDLqvk1h_sGGPHpPU4k8wnKgCPe5OFmILDm5PVNXocriNMVd0eGEuheGzwq4AW0ttRWuewo4UFDQ8iPzjx4ueYVSYyXxthnf3tVb3HEMIsLtNTmOs3Dr-bI7fGjhtHTPu88Q0qSaVod5v4mLxM Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: c956cdbbf8d14dfe89b00a63a98dcc2e Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesGetTestJSON-475419519 Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:50:04.609568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c956cdbbf8d14dfe89b00a63a98dcc2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c956cdbbf8d14dfe89b00a63a98dcc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c956cdbbf8d14dfe89b00a63a98dcc2e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c956cdbbf8d14dfe89b00a63a98dcc2e"}]}] Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesGetTestJSON-475419519 Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: c956cdbbf8d14dfe89b00a63a98dcc2e Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesGetTestJSON-475419519 Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesGetTestJSON-475419519-project Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: f169cd11553546adb4aceb8c0672a084 Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesGetTestJSON-475419519-project Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Volume 19030dbf-81c9-4cb4-aa54-b40551c3c64e could not be found. Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '19030dbf-81c9-4cb4-aa54-b40551c3c64e'} Jul 18 16:50:04.610894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19030dbf-81c9-4cb4-aa54-b40551c3c64e could not be found. (HTTP 404) (Request-ID: req-8e211243-e397-413b-9076-7738a17845c9) Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:04.611730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:50:04.612752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19030dbf-81c9-4cb4-aa54-b40551c3c64e could not be found. Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:50:04.615732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19030dbf-81c9-4cb4-aa54-b40551c3c64e could not be found. Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19030dbf-81c9-4cb4-aa54-b40551c3c64e could not be found. Jul 18 16:50:04.617382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:50:04.619778 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-db9dd893-b713-4c03-a14a-fd5172b2f024 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] Returning 404 to user: Volume 19030dbf-81c9-4cb4-aa54-b40551c3c64e could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:50:04.621077 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-db9dd893-b713-4c03-a14a-fd5172b2f024 tempest-VolumesGetTestJSON-475419519 tempest-VolumesGetTestJSON-475419519-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e" status: 404 len: 109 microversion: 2.1 time: 0.465259 Jul 18 16:50:04.621947 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 10/17] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:50:04 2022] GET /compute/v2.1/os-volumes/19030dbf-81c9-4cb4-aa54-b40551c3c64e => generated 109 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:50:06.506726 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-650dc661-c648-4364-8436-014a5ed56b52 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f70c0160>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:06.673617 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-650dc661-c648-4364-8436-014a5ed56b52 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/7c0f25a2-6f3b-4995-8854-6b4ef2894a96" status: 200 len: 350 microversion: 2.1 time: 0.174324 Jul 18 16:50:06.677584 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 8/18] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 16:50:06 2022] GET /compute/v2.1/os-volumes/7c0f25a2-6f3b-4995-8854-6b4ef2894a96 => generated 350 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:06.699503 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-dd025d79-f93a-42f1-9f24-e7cf148cebd4 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f7077d30>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:06.906942 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-dd025d79-f93a-42f1-9f24-e7cf148cebd4 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.211850 Jul 18 16:50:06.907530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 11/19] 10.222.0.88 () {58 vars in 1133 bytes} [Mon Jul 18 16:50:06 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:06.921374 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e02455b0-d3ca-4510-b495-71a56a584e4d tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f70b9ee0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:07.055977 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e02455b0-d3ca-4510-b495-71a56a584e4d tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.138079 Jul 18 16:50:07.060304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 9/20] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 18 16:50:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:07.081252 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a2992912-414e-473f-8db7-ed563832214d tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f7077790>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:07.215702 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a2992912-414e-473f-8db7-ed563832214d tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.140926 Jul 18 16:50:07.224916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 12/21] 10.222.0.88 () {58 vars in 1133 bytes} [Mon Jul 18 16:50:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:07.228411 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3c648346-a285-4430-ba53-fbfa1fab34c7 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f70b9ca0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:07.549039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3c648346-a285-4430-ba53-fbfa1fab34c7 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.324546 Jul 18 16:50:07.549953 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 10/22] 10.222.0.88 () {58 vars in 1166 bytes} [Mon Jul 18 16:50:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:07.566274 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b74b7974-c0c8-4bbf-bc88-0c09cb3566c3 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f70cdaf0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:07.800307 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b74b7974-c0c8-4bbf-bc88-0c09cb3566c3 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.240935 Jul 18 16:50:07.808282 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 13/23] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 18 16:50:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:07.822396 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1dbe35f1-d96f-4d34-9196-4620cc68f5b3 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f70c0ca0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:08.062134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1dbe35f1-d96f-4d34-9196-4620cc68f5b3 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.243623 Jul 18 16:50:08.064940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 11/24] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 16:50:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:08.090106 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5195d735-dfb4-4291-a7f5-174c1c9d77a4 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f708b700>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:08.344268 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5195d735-dfb4-4291-a7f5-174c1c9d77a4 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.267123 Jul 18 16:50:08.356387 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 14/25] 10.222.0.88 () {58 vars in 1187 bytes} [Mon Jul 18 16:50:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:08.359260 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2b4965e5-422d-4c26-910a-5a712eca2ca6 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] Calling method '.version_select at 0x7fd4f70c08b0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:08.571534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2b4965e5-422d-4c26-910a-5a712eca2ca6 tempest-VolumesTestJSON-2145307523 tempest-VolumesTestJSON-2145307523-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.216072 Jul 18 16:50:08.572414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 12/26] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 18 16:50:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:12.538152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-365236963", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:12.822285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] validate_networks() for [('30fcea63-502f-43e4-90e7-89703318f070', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:50:13.473671 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2891cbbc-aa87-4bdd-a084-19bbd33e1084 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'create', calling method: .version_select at 0x7fd4f70b98b0>, body: {"keypair": {"name": "tempest-keypair-1188601585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPMQJLsBliu2fz8Lr+Fp915VFDjUtCglb6lsE0Qtwo4x9OrHDhzJSmgLApfJXJx6lR5fsfoIV3diWUJ0Z0K4GP6XcdOVKUeRc1TnXnRXXReZ16I11ApgMDOxjEN/+R5ew=="}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:13.566784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-2891cbbc-aa87-4bdd-a084-19bbd33e1084 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Getting quotas for project e8bca7eae3a348069131e97b048412b5. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:50:13.574181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-2891cbbc-aa87-4bdd-a084-19bbd33e1084 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Getting quotas for user 6890f2e62cfd46999791d4a10a81f95c and project e8bca7eae3a348069131e97b048412b5. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:50:13.717034 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2891cbbc-aa87-4bdd-a084-19bbd33e1084 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.849592 Jul 18 16:50:13.717034 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 13/27] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:50:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:15.623387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1653191092", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "networks": [{"uuid": "9493a430-632c-44f2-b5d8-094cd364eec7"}]}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:15.893360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] validate_networks() for [('9493a430-632c-44f2-b5d8-094cd364eec7', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:50:16.580975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:50:16.580975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:50:16.580975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:50:16.580975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:50:16.580975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:50:16.674032 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:16.677455 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:16.686176 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:16.686772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:16.750674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Getting quotas for project 6299ea3e56e84d3cbd2e8f74ef62510e. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:50:16.758172 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Getting quotas for user f2d1f86034b94e289bb1fc754f02f4ac and project 6299ea3e56e84d3cbd2e8f74ef62510e. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:50:16.798057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:50:16.805314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:50:17.132982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8e2bdee1-0f57-4bd2-b859-269f21bc7ae9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.341186 Jul 18 16:50:17.133973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 15/28] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:50:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 5343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:50:17.145967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-28984f0c-dfe8-48ab-88f1-7c1b03ebac52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:17.146916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-28984f0c-dfe8-48ab-88f1-7c1b03ebac52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:17.396354 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-28984f0c-dfe8-48ab-88f1-7c1b03ebac52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:17.415405 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-28984f0c-dfe8-48ab-88f1-7c1b03ebac52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1221 microversion: 2.1 time: 0.273711 Jul 18 16:50:17.429915 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 16/29] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:17 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1221 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:17.898504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1475285989", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:18.038573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] validate_networks() for [('30fcea63-502f-43e4-90e7-89703318f070', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:50:18.473947 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:50:18.474414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:50:18.474865 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:50:18.475327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:50:18.475749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:50:18.492634 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:18.493127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:18.493924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:18.496981 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:18.533436 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Getting quotas for project b61afdae54fc4f76b7dd31798c4226f4. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:50:18.539447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Getting quotas for user baaf254c2b28444bab7f1c7cc3fbc42c and project b61afdae54fc4f76b7dd31798c4226f4. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:50:18.553001 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:50:18.556251 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:50:18.752016 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:50:18.752792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:50:18.756807 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:50:18.757596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:50:18.758293 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:50:18.771600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:18.773972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:18.773972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:18.773972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:18.777579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2be50957-3c5c-42ca-9586-2637c1997e52 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.229084 Jul 18 16:50:18.782073 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 14/30] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:50:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:50:18.794403 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e8f4783c-fc6d-4ce3-ac14-bff18b239d41 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:18.802866 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e8f4783c-fc6d-4ce3-ac14-bff18b239d41 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:18.822122 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Getting quotas for project 6299ea3e56e84d3cbd2e8f74ef62510e. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:50:18.833336 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Getting quotas for user f2d1f86034b94e289bb1fc754f02f4ac and project 6299ea3e56e84d3cbd2e8f74ef62510e. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:50:18.897262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:50:18.913231 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:50:19.045193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e8f4783c-fc6d-4ce3-ac14-bff18b239d41 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:19.088052 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e8f4783c-fc6d-4ce3-ac14-bff18b239d41 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1215 microversion: 2.1 time: 0.283046 Jul 18 16:50:19.094336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 15/31] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:18 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:19.150123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1aed1c4a-ac89-46df-940b-6cf69039e7f4 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.255855 Jul 18 16:50:19.151990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 17/32] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:50:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:50:19.163792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5002f62d-12d6-40fc-8a2d-876487f49357 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:19.164720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5002f62d-12d6-40fc-8a2d-876487f49357 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:19.442778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5002f62d-12d6-40fc-8a2d-876487f49357 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:19.454319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5002f62d-12d6-40fc-8a2d-876487f49357 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1222 microversion: 2.1 time: 0.296998 Jul 18 16:50:19.464255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 16/33] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:19 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1222 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:19.989720 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1365994749", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0dd368f-243f-48b8-8894-e198d646cac0"}], "security_groups": [{"name": "tempest-securitygroup--177601717"}], "key_name": "tempest-keypair-1188601585", "user_data": "}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:20.110554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-197ef6a7-8c11-4ac5-abad-941043d47b04 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:20.112447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-197ef6a7-8c11-4ac5-abad-941043d47b04 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:20.308478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] validate_networks() for [('e0dd368f-243f-48b8-8894-e198d646cac0', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:50:20.377422 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-197ef6a7-8c11-4ac5-abad-941043d47b04 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:20.387158 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-197ef6a7-8c11-4ac5-abad-941043d47b04 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1215 microversion: 2.1 time: 0.280673 Jul 18 16:50:20.390731 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 17/34] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:20 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:20.472852 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-10a74bc7-861b-4971-a7d1-bdb4b087f384 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:20.475290 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-10a74bc7-861b-4971-a7d1-bdb4b087f384 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:20.622673 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-10a74bc7-861b-4971-a7d1-bdb4b087f384 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:20.635512 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-10a74bc7-861b-4971-a7d1-bdb4b087f384 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1222 microversion: 2.1 time: 0.167473 Jul 18 16:50:20.644982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 18/35] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:20 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1222 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:21.059199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:50:21.059713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:50:21.060085 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:50:21.060493 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:50:21.061444 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:50:21.083173 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:21.083651 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:21.086148 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:21.086594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:21.114967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Getting quotas for project e8bca7eae3a348069131e97b048412b5. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:50:21.121233 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Getting quotas for user 6890f2e62cfd46999791d4a10a81f95c and project e8bca7eae3a348069131e97b048412b5. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:50:21.171655 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:50:21.179974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:50:21.357718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-fbd50a20-2b4c-4d1a-ad7c-b42064a0d194 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.374436 Jul 18 16:50:21.366513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 18/36] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:50:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:50:21.376279 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a992efc0-5c96-4274-86df-26b52dd22e99 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:21.379051 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a992efc0-5c96-4274-86df-26b52dd22e99 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:21.409598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c7ab6314-6dd2-4f10-b3d3-ea11030025cd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:21.411328 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c7ab6314-6dd2-4f10-b3d3-ea11030025cd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:21.499174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c7ab6314-6dd2-4f10-b3d3-ea11030025cd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:21.514305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c7ab6314-6dd2-4f10-b3d3-ea11030025cd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1215 microversion: 2.1 time: 0.110263 Jul 18 16:50:21.514992 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 19/37] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:21 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:21.557715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a992efc0-5c96-4274-86df-26b52dd22e99 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:21.568650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a992efc0-5c96-4274-86df-26b52dd22e99 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1238 microversion: 2.1 time: 0.197722 Jul 18 16:50:21.578982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 19/38] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:21 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1238 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:21.652852 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d4d0cd68-1cf9-4c56-8d4c-3305524c0430 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:21.653615 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d4d0cd68-1cf9-4c56-8d4c-3305524c0430 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:21.685298 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d4d0cd68-1cf9-4c56-8d4c-3305524c0430 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:21.685766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d4d0cd68-1cf9-4c56-8d4c-3305524c0430 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:21.688861 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d4d0cd68-1cf9-4c56-8d4c-3305524c0430 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:21.688861 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d4d0cd68-1cf9-4c56-8d4c-3305524c0430 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:21.868214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d4d0cd68-1cf9-4c56-8d4c-3305524c0430 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:21.870897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d4d0cd68-1cf9-4c56-8d4c-3305524c0430 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1226 microversion: 2.1 time: 0.222613 Jul 18 16:50:21.872179 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 20/39] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:21 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1226 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:22.539226 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5886931d-ae75-4c1e-85a0-d71bef847055 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:22.540629 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5886931d-ae75-4c1e-85a0-d71bef847055 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:22.589332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-45f63da7-dcd7-45a3-b931-6cb9dd622caa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:22.590064 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-45f63da7-dcd7-45a3-b931-6cb9dd622caa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:22.595827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5886931d-ae75-4c1e-85a0-d71bef847055 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:22.601789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5886931d-ae75-4c1e-85a0-d71bef847055 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:22.604033 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5886931d-ae75-4c1e-85a0-d71bef847055 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:22.604033 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5886931d-ae75-4c1e-85a0-d71bef847055 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:22.696107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-45f63da7-dcd7-45a3-b931-6cb9dd622caa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:22.710249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-45f63da7-dcd7-45a3-b931-6cb9dd622caa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1238 microversion: 2.1 time: 0.123983 Jul 18 16:50:22.711289 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 21/40] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:22 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1238 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:22.895646 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e08de7d1-a89b-4ad9-9488-05fe722e7dde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:22.895646 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e08de7d1-a89b-4ad9-9488-05fe722e7dde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:22.903425 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5886931d-ae75-4c1e-85a0-d71bef847055 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:22.905369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e08de7d1-a89b-4ad9-9488-05fe722e7dde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:22.906023 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e08de7d1-a89b-4ad9-9488-05fe722e7dde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:22.907069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e08de7d1-a89b-4ad9-9488-05fe722e7dde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:22.907941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e08de7d1-a89b-4ad9-9488-05fe722e7dde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:22.928109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5886931d-ae75-4c1e-85a0-d71bef847055 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1211 microversion: 2.1 time: 0.398076 Jul 18 16:50:22.944403 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 20/41] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:22 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1211 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:23.078697 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e08de7d1-a89b-4ad9-9488-05fe722e7dde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:23.098916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e08de7d1-a89b-4ad9-9488-05fe722e7dde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1218 microversion: 2.1 time: 0.214992 Jul 18 16:50:23.099690 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 22/42] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:22 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1218 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:23.735676 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1f71d054-7ce7-450d-961e-f5bfac3d7528 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:23.736530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1f71d054-7ce7-450d-961e-f5bfac3d7528 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:23.748089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1f71d054-7ce7-450d-961e-f5bfac3d7528 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.748704 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1f71d054-7ce7-450d-961e-f5bfac3d7528 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.749570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1f71d054-7ce7-450d-961e-f5bfac3d7528 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.750089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1f71d054-7ce7-450d-961e-f5bfac3d7528 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.857942 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1f71d054-7ce7-450d-961e-f5bfac3d7528 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:23.868248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1f71d054-7ce7-450d-961e-f5bfac3d7528 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1242 microversion: 2.1 time: 0.143318 Jul 18 16:50:23.869127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 21/43] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:23 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1242 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:23.949000 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f0567ae9-bab7-4439-a1b1-eed4a2489a47 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:23.949744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f0567ae9-bab7-4439-a1b1-eed4a2489a47 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:23.957888 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0567ae9-bab7-4439-a1b1-eed4a2489a47 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.958438 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0567ae9-bab7-4439-a1b1-eed4a2489a47 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:23.959644 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0567ae9-bab7-4439-a1b1-eed4a2489a47 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:23.962746 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0567ae9-bab7-4439-a1b1-eed4a2489a47 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.073221 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f0567ae9-bab7-4439-a1b1-eed4a2489a47 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:24.084483 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f0567ae9-bab7-4439-a1b1-eed4a2489a47 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1267 microversion: 2.1 time: 0.139852 Jul 18 16:50:24.085821 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 23/44] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:23 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:24.116465 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2746e75c-fc2a-47c9-8e43-b15d9eb1123f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:24.117341 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2746e75c-fc2a-47c9-8e43-b15d9eb1123f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:24.131064 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2746e75c-fc2a-47c9-8e43-b15d9eb1123f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.131526 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2746e75c-fc2a-47c9-8e43-b15d9eb1123f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.132485 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2746e75c-fc2a-47c9-8e43-b15d9eb1123f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.139352 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2746e75c-fc2a-47c9-8e43-b15d9eb1123f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.220649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2746e75c-fc2a-47c9-8e43-b15d9eb1123f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:24.232702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2746e75c-fc2a-47c9-8e43-b15d9eb1123f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1274 microversion: 2.1 time: 0.121031 Jul 18 16:50:24.247191 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 22/45] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:24 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:24.886636 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-dd5e4e06-0db1-466a-90f4-69638e455b32 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:24.889673 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-dd5e4e06-0db1-466a-90f4-69638e455b32 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:24.893842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dd5e4e06-0db1-466a-90f4-69638e455b32 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.894294 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dd5e4e06-0db1-466a-90f4-69638e455b32 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.895369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dd5e4e06-0db1-466a-90f4-69638e455b32 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:24.895808 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dd5e4e06-0db1-466a-90f4-69638e455b32 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:24.966919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-dd5e4e06-0db1-466a-90f4-69638e455b32 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:24.978538 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-dd5e4e06-0db1-466a-90f4-69638e455b32 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1242 microversion: 2.1 time: 0.096079 Jul 18 16:50:24.988249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 24/46] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:24 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:25.105800 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a26d6074-5740-4afc-8742-e742e99a1f9b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:25.106526 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a26d6074-5740-4afc-8742-e742e99a1f9b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:25.117530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a26d6074-5740-4afc-8742-e742e99a1f9b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.119971 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a26d6074-5740-4afc-8742-e742e99a1f9b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.119971 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a26d6074-5740-4afc-8742-e742e99a1f9b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.125019 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a26d6074-5740-4afc-8742-e742e99a1f9b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.236293 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a26d6074-5740-4afc-8742-e742e99a1f9b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:25.245277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a26d6074-5740-4afc-8742-e742e99a1f9b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1267 microversion: 2.1 time: 0.145861 Jul 18 16:50:25.246327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 23/47] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:25 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:25.256654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e9bb9f7e-5674-48e6-9109-ce1723a88d06 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:25.257457 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e9bb9f7e-5674-48e6-9109-ce1723a88d06 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:25.264205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f7e-5674-48e6-9109-ce1723a88d06 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.264738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f7e-5674-48e6-9109-ce1723a88d06 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.265597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f7e-5674-48e6-9109-ce1723a88d06 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:25.266128 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e9bb9f7e-5674-48e6-9109-ce1723a88d06 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:25.349087 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e9bb9f7e-5674-48e6-9109-ce1723a88d06 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:25.359762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e9bb9f7e-5674-48e6-9109-ce1723a88d06 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1274 microversion: 2.1 time: 0.106337 Jul 18 16:50:25.360368 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 25/48] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:25 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:25.995954 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0e9118c0-5d9d-40c4-9dd4-7dad7da0613f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:26.000126 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0e9118c0-5d9d-40c4-9dd4-7dad7da0613f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:26.002955 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e9118c0-5d9d-40c4-9dd4-7dad7da0613f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.003549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e9118c0-5d9d-40c4-9dd4-7dad7da0613f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.004398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e9118c0-5d9d-40c4-9dd4-7dad7da0613f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.004964 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e9118c0-5d9d-40c4-9dd4-7dad7da0613f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.069946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0e9118c0-5d9d-40c4-9dd4-7dad7da0613f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:26.079110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0e9118c0-5d9d-40c4-9dd4-7dad7da0613f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1242 microversion: 2.1 time: 0.087068 Jul 18 16:50:26.080682 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 24/49] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:25 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:26.267034 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8a250ca2-120d-4cae-a1cc-6d03891ebf9c tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:26.267760 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8a250ca2-120d-4cae-a1cc-6d03891ebf9c tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:26.274985 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8a250ca2-120d-4cae-a1cc-6d03891ebf9c tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.275630 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8a250ca2-120d-4cae-a1cc-6d03891ebf9c tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.276480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8a250ca2-120d-4cae-a1cc-6d03891ebf9c tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.277024 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8a250ca2-120d-4cae-a1cc-6d03891ebf9c tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.357628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8a250ca2-120d-4cae-a1cc-6d03891ebf9c tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:26.366609 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8a250ca2-120d-4cae-a1cc-6d03891ebf9c tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1267 microversion: 2.1 time: 0.103330 Jul 18 16:50:26.367649 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 26/50] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:26 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:26.382890 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-500535ed-6d0a-439d-bda9-22a5653f44ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:26.383814 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-500535ed-6d0a-439d-bda9-22a5653f44ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:26.390476 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-500535ed-6d0a-439d-bda9-22a5653f44ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.391033 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-500535ed-6d0a-439d-bda9-22a5653f44ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.391982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-500535ed-6d0a-439d-bda9-22a5653f44ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:26.392431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-500535ed-6d0a-439d-bda9-22a5653f44ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:26.482843 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-500535ed-6d0a-439d-bda9-22a5653f44ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:26.492202 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-500535ed-6d0a-439d-bda9-22a5653f44ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1274 microversion: 2.1 time: 0.113844 Jul 18 16:50:26.492857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 25/51] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:26 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:27.097999 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-334f6b8e-3d1a-4313-84e4-e63b8ae6c3f4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:27.098395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-334f6b8e-3d1a-4313-84e4-e63b8ae6c3f4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:27.107743 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-334f6b8e-3d1a-4313-84e4-e63b8ae6c3f4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.108206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-334f6b8e-3d1a-4313-84e4-e63b8ae6c3f4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.112131 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-334f6b8e-3d1a-4313-84e4-e63b8ae6c3f4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.112131 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-334f6b8e-3d1a-4313-84e4-e63b8ae6c3f4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.172980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-334f6b8e-3d1a-4313-84e4-e63b8ae6c3f4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:27.180827 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-334f6b8e-3d1a-4313-84e4-e63b8ae6c3f4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1234 microversion: 2.1 time: 0.088330 Jul 18 16:50:27.181429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 27/52] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:27 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1234 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:27.385417 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3cf4a67f-f630-44f9-9113-9073996933f7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:27.386103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3cf4a67f-f630-44f9-9113-9073996933f7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:27.392469 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3cf4a67f-f630-44f9-9113-9073996933f7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.392953 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3cf4a67f-f630-44f9-9113-9073996933f7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.393823 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3cf4a67f-f630-44f9-9113-9073996933f7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.394327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3cf4a67f-f630-44f9-9113-9073996933f7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.498556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3cf4a67f-f630-44f9-9113-9073996933f7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:27.508785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3cf4a67f-f630-44f9-9113-9073996933f7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1275 microversion: 2.1 time: 0.127136 Jul 18 16:50:27.510445 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bb904047-18d3-4c94-9387-7c33a53e2754 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:27.511986 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bb904047-18d3-4c94-9387-7c33a53e2754 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:27.519775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 26/53] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:27 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:27.522195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bb904047-18d3-4c94-9387-7c33a53e2754 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.526429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bb904047-18d3-4c94-9387-7c33a53e2754 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.526429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bb904047-18d3-4c94-9387-7c33a53e2754 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:27.526429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bb904047-18d3-4c94-9387-7c33a53e2754 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:27.587291 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-bb904047-18d3-4c94-9387-7c33a53e2754 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:27.595291 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bb904047-18d3-4c94-9387-7c33a53e2754 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1282 microversion: 2.1 time: 0.090254 Jul 18 16:50:27.595796 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 28/54] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:27 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:28.198387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d3b932de-ca4d-4ed7-9695-dee9c7fac6b6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:28.198999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d3b932de-ca4d-4ed7-9695-dee9c7fac6b6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:28.212101 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d3b932de-ca4d-4ed7-9695-dee9c7fac6b6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:28.212908 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d3b932de-ca4d-4ed7-9695-dee9c7fac6b6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.214631 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d3b932de-ca4d-4ed7-9695-dee9c7fac6b6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:28.215936 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d3b932de-ca4d-4ed7-9695-dee9c7fac6b6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.325893 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d3b932de-ca4d-4ed7-9695-dee9c7fac6b6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:28.341699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d3b932de-ca4d-4ed7-9695-dee9c7fac6b6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1234 microversion: 2.1 time: 0.146587 Jul 18 16:50:28.342837 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 27/55] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:28 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1234 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:28.526083 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-596f4f95-726e-455b-ace9-ded277f80c4f tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:28.526842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-596f4f95-726e-455b-ace9-ded277f80c4f tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:28.532852 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-596f4f95-726e-455b-ace9-ded277f80c4f tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:28.533343 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-596f4f95-726e-455b-ace9-ded277f80c4f tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.534122 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-596f4f95-726e-455b-ace9-ded277f80c4f tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:28.534571 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-596f4f95-726e-455b-ace9-ded277f80c4f tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.614970 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-596f4f95-726e-455b-ace9-ded277f80c4f tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:28.617234 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a9daf3b5-a381-4d2a-ac4f-e5f52110c54f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:28.617996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a9daf3b5-a381-4d2a-ac4f-e5f52110c54f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:28.621635 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:28.626557 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a9daf3b5-a381-4d2a-ac4f-e5f52110c54f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:28.627325 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a9daf3b5-a381-4d2a-ac4f-e5f52110c54f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.628349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a9daf3b5-a381-4d2a-ac4f-e5f52110c54f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:28.629060 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a9daf3b5-a381-4d2a-ac4f-e5f52110c54f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:28.631619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-596f4f95-726e-455b-ace9-ded277f80c4f tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1275 microversion: 2.1 time: 0.109111 Jul 18 16:50:28.632664 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 29/56] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:28 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:28.724078 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a9daf3b5-a381-4d2a-ac4f-e5f52110c54f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:28.737473 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a9daf3b5-a381-4d2a-ac4f-e5f52110c54f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1282 microversion: 2.1 time: 0.124660 Jul 18 16:50:28.738350 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 28/57] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:28 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:29.361757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-690a3b5e-7c25-4857-bbc7-45e871719039 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:29.362581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-690a3b5e-7c25-4857-bbc7-45e871719039 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:29.376175 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-690a3b5e-7c25-4857-bbc7-45e871719039 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.377627 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-690a3b5e-7c25-4857-bbc7-45e871719039 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.378680 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-690a3b5e-7c25-4857-bbc7-45e871719039 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.379338 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-690a3b5e-7c25-4857-bbc7-45e871719039 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.640775 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-690a3b5e-7c25-4857-bbc7-45e871719039 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:29.649884 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-690a3b5e-7c25-4857-bbc7-45e871719039 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1234 microversion: 2.1 time: 0.292582 Jul 18 16:50:29.652577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 30/58] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:29 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1234 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:29.657342 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c45e90c1-76da-44bc-8dd2-531691580585 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:29.658079 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c45e90c1-76da-44bc-8dd2-531691580585 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:29.677460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c45e90c1-76da-44bc-8dd2-531691580585 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.680138 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c45e90c1-76da-44bc-8dd2-531691580585 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.681006 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c45e90c1-76da-44bc-8dd2-531691580585 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.681468 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c45e90c1-76da-44bc-8dd2-531691580585 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.757198 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f7089e93-dcde-4d73-9565-3e575b887425 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:29.757844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f7089e93-dcde-4d73-9565-3e575b887425 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:29.764462 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7089e93-dcde-4d73-9565-3e575b887425 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.765174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7089e93-dcde-4d73-9565-3e575b887425 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.766498 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7089e93-dcde-4d73-9565-3e575b887425 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:29.767089 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7089e93-dcde-4d73-9565-3e575b887425 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:29.868720 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f7089e93-dcde-4d73-9565-3e575b887425 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:29.878775 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f7089e93-dcde-4d73-9565-3e575b887425 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1292 microversion: 2.1 time: 0.126901 Jul 18 16:50:29.881228 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 31/59] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:29 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1292 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:29.947209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c45e90c1-76da-44bc-8dd2-531691580585 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:29.957163 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c45e90c1-76da-44bc-8dd2-531691580585 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1285 microversion: 2.1 time: 0.307310 Jul 18 16:50:29.957974 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 29/60] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:29 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1285 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:30.669796 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-84988177-e17a-4552-b36e-c63070761f6f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:30.670843 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-84988177-e17a-4552-b36e-c63070761f6f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:30.682265 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-84988177-e17a-4552-b36e-c63070761f6f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:30.684025 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-84988177-e17a-4552-b36e-c63070761f6f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:30.686397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-84988177-e17a-4552-b36e-c63070761f6f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:30.687477 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-84988177-e17a-4552-b36e-c63070761f6f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:30.787804 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-84988177-e17a-4552-b36e-c63070761f6f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:30.796932 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-84988177-e17a-4552-b36e-c63070761f6f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1298 microversion: 2.1 time: 0.131449 Jul 18 16:50:30.797512 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 32/61] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:30 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:30.915185 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cfe13308-0bcb-450f-9e9b-58dfa6a8e780 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:30.915185 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cfe13308-0bcb-450f-9e9b-58dfa6a8e780 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:30.947202 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cfe13308-0bcb-450f-9e9b-58dfa6a8e780 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:30.948811 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cfe13308-0bcb-450f-9e9b-58dfa6a8e780 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:30.952490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cfe13308-0bcb-450f-9e9b-58dfa6a8e780 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:30.953610 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cfe13308-0bcb-450f-9e9b-58dfa6a8e780 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:30.975974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f4650953-4770-4f08-b745-a68ad2371bcd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:30.976741 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f4650953-4770-4f08-b745-a68ad2371bcd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:30.994750 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4650953-4770-4f08-b745-a68ad2371bcd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.000042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4650953-4770-4f08-b745-a68ad2371bcd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.003490 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4650953-4770-4f08-b745-a68ad2371bcd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.005335 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4650953-4770-4f08-b745-a68ad2371bcd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.097522 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=6 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:31.193168 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f4650953-4770-4f08-b745-a68ad2371bcd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:31.240871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f4650953-4770-4f08-b745-a68ad2371bcd tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1273 microversion: 2.1 time: 0.268520 Jul 18 16:50:31.245617 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 33/62] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:30 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:31.563699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=20 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:31.694752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cfe13308-0bcb-450f-9e9b-58dfa6a8e780 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:31.711532 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cfe13308-0bcb-450f-9e9b-58dfa6a8e780 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.816819 Jul 18 16:50:31.712835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 30/63] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:30 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:31.822418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-22e9d00e-b983-4a22-a9f4-6f55e1521078 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:31.823356 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-22e9d00e-b983-4a22-a9f4-6f55e1521078 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:31.837925 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-22e9d00e-b983-4a22-a9f4-6f55e1521078 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.841467 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-22e9d00e-b983-4a22-a9f4-6f55e1521078 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:31.842249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-22e9d00e-b983-4a22-a9f4-6f55e1521078 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:31.844753 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-22e9d00e-b983-4a22-a9f4-6f55e1521078 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:32.004450 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-22e9d00e-b983-4a22-a9f4-6f55e1521078 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:32.025305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-22e9d00e-b983-4a22-a9f4-6f55e1521078 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1296 microversion: 2.1 time: 0.200664 Jul 18 16:50:32.025305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 34/64] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:31 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1296 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:32.270838 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9edeeb49-e663-4c89-a94c-342f9df656fc tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:32.272039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9edeeb49-e663-4c89-a94c-342f9df656fc tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:32.301905 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9edeeb49-e663-4c89-a94c-342f9df656fc tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:32.302992 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9edeeb49-e663-4c89-a94c-342f9df656fc tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:32.308845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9edeeb49-e663-4c89-a94c-342f9df656fc tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:32.311210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9edeeb49-e663-4c89-a94c-342f9df656fc tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:32.734031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-965a69b0-c682-4f88-841e-e09ff906c179 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:32.746636 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-965a69b0-c682-4f88-841e-e09ff906c179 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:32.746636 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=24 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:32.778363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-965a69b0-c682-4f88-841e-e09ff906c179 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:32.779196 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-965a69b0-c682-4f88-841e-e09ff906c179 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:32.781702 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-965a69b0-c682-4f88-841e-e09ff906c179 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:32.787315 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-965a69b0-c682-4f88-841e-e09ff906c179 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:33.196693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9edeeb49-e663-4c89-a94c-342f9df656fc tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:33.220369 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9edeeb49-e663-4c89-a94c-342f9df656fc tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.944637 Jul 18 16:50:33.223741 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 31/65] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:32 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:33.239260 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-57e517c1-66f8-4e08-93cd-693de9af4a5e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:33.241196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-57e517c1-66f8-4e08-93cd-693de9af4a5e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:33.259288 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-57e517c1-66f8-4e08-93cd-693de9af4a5e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:33.261986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-57e517c1-66f8-4e08-93cd-693de9af4a5e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:33.265623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-57e517c1-66f8-4e08-93cd-693de9af4a5e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:33.267468 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-57e517c1-66f8-4e08-93cd-693de9af4a5e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:33.369664 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-965a69b0-c682-4f88-841e-e09ff906c179 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:33.382901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-965a69b0-c682-4f88-841e-e09ff906c179 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.656298 Jul 18 16:50:33.384958 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 35/66] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:32 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:33.563177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-57e517c1-66f8-4e08-93cd-693de9af4a5e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:33.592554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-57e517c1-66f8-4e08-93cd-693de9af4a5e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1296 microversion: 2.1 time: 0.367334 Jul 18 16:50:33.606738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 32/67] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:33 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1296 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:34.240690 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-94627d3b-d508-4163-9096-1cca3c916c31 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:34.241416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-94627d3b-d508-4163-9096-1cca3c916c31 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:34.255873 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-94627d3b-d508-4163-9096-1cca3c916c31 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:34.255873 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-94627d3b-d508-4163-9096-1cca3c916c31 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:34.255873 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-94627d3b-d508-4163-9096-1cca3c916c31 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:34.255873 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-94627d3b-d508-4163-9096-1cca3c916c31 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:34.299911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:34.404560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-949026b5-b34b-4779-b880-d61edab1513c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:34.405374 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-949026b5-b34b-4779-b880-d61edab1513c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:34.433899 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-949026b5-b34b-4779-b880-d61edab1513c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:34.433899 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-949026b5-b34b-4779-b880-d61edab1513c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:34.433899 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-949026b5-b34b-4779-b880-d61edab1513c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:34.433899 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-949026b5-b34b-4779-b880-d61edab1513c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:34.666893 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-94627d3b-d508-4163-9096-1cca3c916c31 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:34.679367 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-94627d3b-d508-4163-9096-1cca3c916c31 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.440725 Jul 18 16:50:34.680573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 36/68] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:34 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:34.704856 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-355a4e8b-9ffb-49af-adf5-fb763b20206e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:34.713984 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-355a4e8b-9ffb-49af-adf5-fb763b20206e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:34.731892 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-355a4e8b-9ffb-49af-adf5-fb763b20206e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:34.732354 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-355a4e8b-9ffb-49af-adf5-fb763b20206e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:34.733176 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-355a4e8b-9ffb-49af-adf5-fb763b20206e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:34.733616 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-355a4e8b-9ffb-49af-adf5-fb763b20206e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:34.965474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-355a4e8b-9ffb-49af-adf5-fb763b20206e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:34.973951 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-355a4e8b-9ffb-49af-adf5-fb763b20206e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.292082 Jul 18 16:50:34.975785 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 37/69] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:34 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:35.041820 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-949026b5-b34b-4779-b880-d61edab1513c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:35.058315 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-949026b5-b34b-4779-b880-d61edab1513c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.658280 Jul 18 16:50:35.058315 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 33/70] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:34 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:35.700853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-33624b7e-4c96-40a0-a20c-a9e362862890 req-3ab495c3-b5ac-4346-afb4-7b376ca45639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "961bdca6-9130-4433-86dc-657618b53284", "tag": "62fdbe46-c000-4272-99a3-12a2a443665b"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:35.701723 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f1c3442f-211b-4a8c-aac9-78c3d532043d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:35.702657 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f1c3442f-211b-4a8c-aac9-78c3d532043d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:35.717686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f1c3442f-211b-4a8c-aac9-78c3d532043d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:35.717686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f1c3442f-211b-4a8c-aac9-78c3d532043d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:35.718328 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f1c3442f-211b-4a8c-aac9-78c3d532043d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:35.720229 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f1c3442f-211b-4a8c-aac9-78c3d532043d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:35.746250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-33624b7e-4c96-40a0-a20c-a9e362862890 req-3ab495c3-b5ac-4346-afb4-7b376ca45639 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:35.746710 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-33624b7e-4c96-40a0-a20c-a9e362862890 req-3ab495c3-b5ac-4346-afb4-7b376ca45639 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:35.792457 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-33624b7e-4c96-40a0-a20c-a9e362862890 req-3ab495c3-b5ac-4346-afb4-7b376ca45639 service nova] Creating event network-changed:62fdbe46-c000-4272-99a3-12a2a443665b for instance 961bdca6-9130-4433-86dc-657618b53284 on hv-cinder-84617 Jul 18 16:50:35.793139 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-33624b7e-4c96-40a0-a20c-a9e362862890 req-3ab495c3-b5ac-4346-afb4-7b376ca45639 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124753) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 16:50:35.794162 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6cbd7785-bd44-45cf-a062-f1ae6bb9f007 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:35.794797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6cbd7785-bd44-45cf-a062-f1ae6bb9f007 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:35.795734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6cbd7785-bd44-45cf-a062-f1ae6bb9f007 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:35.796513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6cbd7785-bd44-45cf-a062-f1ae6bb9f007 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:35.807182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.compute.rpcapi [None req-6cbd7785-bd44-45cf-a062-f1ae6bb9f007 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 16:50:35.814015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6cbd7785-bd44-45cf-a062-f1ae6bb9f007 None None] Releasing lock "compute-rpcapi-router" {{(pid=124753) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 16:50:35.840823 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6cbd7785-bd44-45cf-a062-f1ae6bb9f007 None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410258 Jul 18 16:50:35.842228 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 38/71] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:35.991020 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f1c3442f-211b-4a8c-aac9-78c3d532043d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:36.004871 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f1c3442f-211b-4a8c-aac9-78c3d532043d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.312267 Jul 18 16:50:36.006058 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 34/72] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:35 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:36.029773 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-685d2d43-02cf-4c98-be1d-7fd6c804306e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:36.030674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-685d2d43-02cf-4c98-be1d-7fd6c804306e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:36.046491 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-685d2d43-02cf-4c98-be1d-7fd6c804306e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.047139 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-685d2d43-02cf-4c98-be1d-7fd6c804306e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.052221 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-685d2d43-02cf-4c98-be1d-7fd6c804306e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.053002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-685d2d43-02cf-4c98-be1d-7fd6c804306e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.239822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-399d5eef-5966-438e-bf07-db6a77fc9b16 req-a1253cc3-0db7-41bd-9478-2a2ae7756793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3a0d59-9562-45d0-befc-fc63474db543", "tag": "76d4d124-f5eb-4620-a0fa-4acc7c98e2ec"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:36.267370 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:36.276629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-399d5eef-5966-438e-bf07-db6a77fc9b16 req-a1253cc3-0db7-41bd-9478-2a2ae7756793 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.277570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-399d5eef-5966-438e-bf07-db6a77fc9b16 req-a1253cc3-0db7-41bd-9478-2a2ae7756793 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.293019 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-399d5eef-5966-438e-bf07-db6a77fc9b16 req-a1253cc3-0db7-41bd-9478-2a2ae7756793 service nova] Creating event network-changed:76d4d124-f5eb-4620-a0fa-4acc7c98e2ec for instance 6d3a0d59-9562-45d0-befc-fc63474db543 on hv-cinder-84617 Jul 18 16:50:36.310747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-399d5eef-5966-438e-bf07-db6a77fc9b16 req-a1253cc3-0db7-41bd-9478-2a2ae7756793 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349211 Jul 18 16:50:36.311532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 39/73] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:50:36.352267 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-43e37e8d-7288-4f8b-90f0-81ea34586656 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:36.352267 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-43e37e8d-7288-4f8b-90f0-81ea34586656 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:36.367817 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-43e37e8d-7288-4f8b-90f0-81ea34586656 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.369564 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-43e37e8d-7288-4f8b-90f0-81ea34586656 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.374956 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-43e37e8d-7288-4f8b-90f0-81ea34586656 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:36.376393 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-43e37e8d-7288-4f8b-90f0-81ea34586656 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:36.449221 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-685d2d43-02cf-4c98-be1d-7fd6c804306e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:36.459744 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-685d2d43-02cf-4c98-be1d-7fd6c804306e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.452164 Jul 18 16:50:36.470535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 35/74] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:36 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:37.040835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-206c8643-a0c4-4fcc-94c3-419f08dabc08 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:37.049515 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-206c8643-a0c4-4fcc-94c3-419f08dabc08 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:37.049515 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:37.064569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-206c8643-a0c4-4fcc-94c3-419f08dabc08 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:37.074623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-206c8643-a0c4-4fcc-94c3-419f08dabc08 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:37.075784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-206c8643-a0c4-4fcc-94c3-419f08dabc08 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:37.076259 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-206c8643-a0c4-4fcc-94c3-419f08dabc08 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:37.100682 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=100 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:37.257740 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-43e37e8d-7288-4f8b-90f0-81ea34586656 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:37.297734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-43e37e8d-7288-4f8b-90f0-81ea34586656 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.983179 Jul 18 16:50:37.299188 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 40/75] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:36 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:37.482594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c1648252-fff1-44a9-a71f-e39234474a7b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:37.483222 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c1648252-fff1-44a9-a71f-e39234474a7b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:37.511878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1648252-fff1-44a9-a71f-e39234474a7b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:37.512409 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1648252-fff1-44a9-a71f-e39234474a7b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:37.520190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1648252-fff1-44a9-a71f-e39234474a7b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:37.531361 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1648252-fff1-44a9-a71f-e39234474a7b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:38.179892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-206c8643-a0c4-4fcc-94c3-419f08dabc08 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:38.198490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-206c8643-a0c4-4fcc-94c3-419f08dabc08 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 1.166548 Jul 18 16:50:38.202891 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 36/76] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:37 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:38.224418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c1648252-fff1-44a9-a71f-e39234474a7b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:38.235212 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c1648252-fff1-44a9-a71f-e39234474a7b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.759548 Jul 18 16:50:38.248319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 41/77] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:37 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:38.316771 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5ab7f9d3-ee31-4793-b8d4-fd434c14b800 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:38.317414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5ab7f9d3-ee31-4793-b8d4-fd434c14b800 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:38.337484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5ab7f9d3-ee31-4793-b8d4-fd434c14b800 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:38.338355 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5ab7f9d3-ee31-4793-b8d4-fd434c14b800 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:38.339324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5ab7f9d3-ee31-4793-b8d4-fd434c14b800 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:38.340043 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5ab7f9d3-ee31-4793-b8d4-fd434c14b800 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:39.192024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5ab7f9d3-ee31-4793-b8d4-fd434c14b800 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:39.232155 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-589ce35f-f969-4c45-bf13-4dcde962476d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:39.235042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-589ce35f-f969-4c45-bf13-4dcde962476d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:39.249912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5ab7f9d3-ee31-4793-b8d4-fd434c14b800 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.933819 Jul 18 16:50:39.250490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 37/78] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:38 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:39.262388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0571b14e-bc81-42dd-8968-50953affaa13 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:39.262655 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-589ce35f-f969-4c45-bf13-4dcde962476d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:39.263000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0571b14e-bc81-42dd-8968-50953affaa13 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:39.269649 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-589ce35f-f969-4c45-bf13-4dcde962476d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:39.271263 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-589ce35f-f969-4c45-bf13-4dcde962476d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:39.277196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0571b14e-bc81-42dd-8968-50953affaa13 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:39.278175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0571b14e-bc81-42dd-8968-50953affaa13 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:39.279479 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0571b14e-bc81-42dd-8968-50953affaa13 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:39.280298 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0571b14e-bc81-42dd-8968-50953affaa13 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:39.281638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-589ce35f-f969-4c45-bf13-4dcde962476d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:40.158494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-589ce35f-f969-4c45-bf13-4dcde962476d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:40.173256 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-589ce35f-f969-4c45-bf13-4dcde962476d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.959539 Jul 18 16:50:40.173256 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 42/79] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:39 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:40.197071 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0571b14e-bc81-42dd-8968-50953affaa13 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:40.221203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0571b14e-bc81-42dd-8968-50953affaa13 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.963221 Jul 18 16:50:40.222294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 38/80] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:39 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:40.265655 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-35e5f1c7-1712-498a-a27e-cd3d129cb158 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:40.267246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-35e5f1c7-1712-498a-a27e-cd3d129cb158 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:40.289246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35e5f1c7-1712-498a-a27e-cd3d129cb158 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:40.289246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35e5f1c7-1712-498a-a27e-cd3d129cb158 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:40.295618 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35e5f1c7-1712-498a-a27e-cd3d129cb158 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:40.297513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35e5f1c7-1712-498a-a27e-cd3d129cb158 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:40.620296 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-35e5f1c7-1712-498a-a27e-cd3d129cb158 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:40.639396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-35e5f1c7-1712-498a-a27e-cd3d129cb158 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.379159 Jul 18 16:50:40.655740 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 43/81] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:40 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:40.682283 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-6cb9e5a3-1146-4834-93a5-24285da1a89a req-a12af0c1-c736-4415-9799-2e69e3523cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0acf48-1262-4cbc-98dc-562510f2cc10", "tag": "e24ea19f-20d4-44b1-8b36-327ccde66e88"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:40.714371 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-6cb9e5a3-1146-4834-93a5-24285da1a89a req-a12af0c1-c736-4415-9799-2e69e3523cbf service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:40.717832 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-6cb9e5a3-1146-4834-93a5-24285da1a89a req-a12af0c1-c736-4415-9799-2e69e3523cbf service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:40.758698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-6cb9e5a3-1146-4834-93a5-24285da1a89a req-a12af0c1-c736-4415-9799-2e69e3523cbf service nova] Creating event network-changed:e24ea19f-20d4-44b1-8b36-327ccde66e88 for instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 on hv-cinder-84617 Jul 18 16:50:40.758698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-6cb9e5a3-1146-4834-93a5-24285da1a89a req-a12af0c1-c736-4415-9799-2e69e3523cbf service nova] Acquired lock "compute-rpcapi-router" {{(pid=124754) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 16:50:40.760066 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ece325fc-c548-4ab6-826e-0ccfc0fce750 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:40.761082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ece325fc-c548-4ab6-826e-0ccfc0fce750 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:40.762343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ece325fc-c548-4ab6-826e-0ccfc0fce750 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:40.764095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ece325fc-c548-4ab6-826e-0ccfc0fce750 None None] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:40.778228 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.compute.rpcapi [None req-ece325fc-c548-4ab6-826e-0ccfc0fce750 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 16:50:40.779776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ece325fc-c548-4ab6-826e-0ccfc0fce750 None None] Releasing lock "compute-rpcapi-router" {{(pid=124754) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 16:50:40.836601 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ece325fc-c548-4ab6-826e-0ccfc0fce750 None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158127 Jul 18 16:50:40.837209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 39/82] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:41.205875 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b75b55bb-9182-4ad1-b730-918d7eb8f4d6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:41.205875 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b75b55bb-9182-4ad1-b730-918d7eb8f4d6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:41.212784 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b75b55bb-9182-4ad1-b730-918d7eb8f4d6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:41.213718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b75b55bb-9182-4ad1-b730-918d7eb8f4d6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:41.214673 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b75b55bb-9182-4ad1-b730-918d7eb8f4d6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:41.215417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b75b55bb-9182-4ad1-b730-918d7eb8f4d6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:41.241348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0356bf30-8698-4ecd-9a62-e26ad724277b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:41.246912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0356bf30-8698-4ecd-9a62-e26ad724277b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:41.257639 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0356bf30-8698-4ecd-9a62-e26ad724277b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:41.258373 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0356bf30-8698-4ecd-9a62-e26ad724277b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:41.259322 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0356bf30-8698-4ecd-9a62-e26ad724277b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:41.259951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0356bf30-8698-4ecd-9a62-e26ad724277b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:41.420483 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b75b55bb-9182-4ad1-b730-918d7eb8f4d6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:41.430031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b75b55bb-9182-4ad1-b730-918d7eb8f4d6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.229686 Jul 18 16:50:41.430963 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 44/83] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:41 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:41.520709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0356bf30-8698-4ecd-9a62-e26ad724277b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:41.529772 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0356bf30-8698-4ecd-9a62-e26ad724277b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.293581 Jul 18 16:50:41.535139 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 40/84] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:41 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:41.656497 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5ef9f776-8718-4ce3-a708-dafdd21cb3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:41.657134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5ef9f776-8718-4ce3-a708-dafdd21cb3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:41.664028 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5ef9f776-8718-4ce3-a708-dafdd21cb3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:41.664731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5ef9f776-8718-4ce3-a708-dafdd21cb3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:41.665679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5ef9f776-8718-4ce3-a708-dafdd21cb3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:41.666270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5ef9f776-8718-4ce3-a708-dafdd21cb3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:41.820939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5ef9f776-8718-4ce3-a708-dafdd21cb3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:41.829091 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5ef9f776-8718-4ce3-a708-dafdd21cb3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.176249 Jul 18 16:50:41.829847 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 45/85] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:41 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:42.449612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0997c253-e358-4166-a20c-bea2f2dea610 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:42.450350 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0997c253-e358-4166-a20c-bea2f2dea610 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:42.458113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0997c253-e358-4166-a20c-bea2f2dea610 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:42.458640 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0997c253-e358-4166-a20c-bea2f2dea610 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:42.459580 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0997c253-e358-4166-a20c-bea2f2dea610 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:42.460157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0997c253-e358-4166-a20c-bea2f2dea610 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:42.550287 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8831f2fa-04d9-4394-912d-502617f31221 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:42.558274 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8831f2fa-04d9-4394-912d-502617f31221 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:42.566549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8831f2fa-04d9-4394-912d-502617f31221 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:42.567002 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8831f2fa-04d9-4394-912d-502617f31221 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:42.567913 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8831f2fa-04d9-4394-912d-502617f31221 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:42.568372 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8831f2fa-04d9-4394-912d-502617f31221 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:42.624296 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0997c253-e358-4166-a20c-bea2f2dea610 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:42.633775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0997c253-e358-4166-a20c-bea2f2dea610 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.190729 Jul 18 16:50:42.634778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 41/86] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:42 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:42.737589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8831f2fa-04d9-4394-912d-502617f31221 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:42.746610 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8831f2fa-04d9-4394-912d-502617f31221 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.200199 Jul 18 16:50:42.750537 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 46/87] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:42 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:42.846263 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-75fe4071-26cb-4613-bffe-750abe087c83 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:42.848160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-75fe4071-26cb-4613-bffe-750abe087c83 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:42.853693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75fe4071-26cb-4613-bffe-750abe087c83 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:42.854138 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75fe4071-26cb-4613-bffe-750abe087c83 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:42.855070 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75fe4071-26cb-4613-bffe-750abe087c83 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:42.855712 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75fe4071-26cb-4613-bffe-750abe087c83 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:42.873689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-79ca5aaf-6724-4f09-a9d8-2f979a5b492f req-b912586b-4edb-4d05-a1d5-173641cdbf6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67187e3-9b84-4393-a7bf-c15db8b715ee", "tag": "52949cd4-aff2-4ec9-8946-76ec43bfca3e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:50:42.890587 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-79ca5aaf-6724-4f09-a9d8-2f979a5b492f req-b912586b-4edb-4d05-a1d5-173641cdbf6b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:42.891128 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-79ca5aaf-6724-4f09-a9d8-2f979a5b492f req-b912586b-4edb-4d05-a1d5-173641cdbf6b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:42.918520 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-79ca5aaf-6724-4f09-a9d8-2f979a5b492f req-b912586b-4edb-4d05-a1d5-173641cdbf6b service nova] Creating event network-changed:52949cd4-aff2-4ec9-8946-76ec43bfca3e for instance e67187e3-9b84-4393-a7bf-c15db8b715ee on hv-cinder-84617 Jul 18 16:50:42.924194 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-79ca5aaf-6724-4f09-a9d8-2f979a5b492f req-b912586b-4edb-4d05-a1d5-173641cdbf6b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054070 Jul 18 16:50:42.925331 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 47/88] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:50:43.016669 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-75fe4071-26cb-4613-bffe-750abe087c83 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:43.024684 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-75fe4071-26cb-4613-bffe-750abe087c83 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.182433 Jul 18 16:50:43.025314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 42/89] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:42 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:43.651340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-417917d7-aebc-400a-917b-f423fc913b16 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:43.652108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-417917d7-aebc-400a-917b-f423fc913b16 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:43.658881 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-417917d7-aebc-400a-917b-f423fc913b16 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:43.659335 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-417917d7-aebc-400a-917b-f423fc913b16 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:43.660192 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-417917d7-aebc-400a-917b-f423fc913b16 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:43.660641 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-417917d7-aebc-400a-917b-f423fc913b16 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:43.771656 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5db78292-724b-41d6-b931-77580042878b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:43.776588 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5db78292-724b-41d6-b931-77580042878b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:43.779249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5db78292-724b-41d6-b931-77580042878b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:43.781008 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5db78292-724b-41d6-b931-77580042878b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:43.782052 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5db78292-724b-41d6-b931-77580042878b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:43.782728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5db78292-724b-41d6-b931-77580042878b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:43.831487 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-417917d7-aebc-400a-917b-f423fc913b16 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:43.852980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-417917d7-aebc-400a-917b-f423fc913b16 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.205858 Jul 18 16:50:43.853580 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 48/90] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:43 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:44.012489 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5db78292-724b-41d6-b931-77580042878b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:44.023848 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5db78292-724b-41d6-b931-77580042878b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.257260 Jul 18 16:50:44.024635 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 43/91] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:43 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:44.045496 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-17683ea5-4503-4a7b-8b22-222b6b754d52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:44.045924 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-17683ea5-4503-4a7b-8b22-222b6b754d52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:44.052633 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17683ea5-4503-4a7b-8b22-222b6b754d52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:44.053121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17683ea5-4503-4a7b-8b22-222b6b754d52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:44.054323 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17683ea5-4503-4a7b-8b22-222b6b754d52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:44.054764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17683ea5-4503-4a7b-8b22-222b6b754d52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:44.199969 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-17683ea5-4503-4a7b-8b22-222b6b754d52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:44.207609 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-17683ea5-4503-4a7b-8b22-222b6b754d52 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.168189 Jul 18 16:50:44.208186 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 49/92] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:44 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:44.879195 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1bbb66ba-3471-4ff3-8323-966624695a0d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:44.886938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1bbb66ba-3471-4ff3-8323-966624695a0d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:44.888068 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1bbb66ba-3471-4ff3-8323-966624695a0d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:44.888667 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1bbb66ba-3471-4ff3-8323-966624695a0d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:44.889890 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1bbb66ba-3471-4ff3-8323-966624695a0d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:44.890343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1bbb66ba-3471-4ff3-8323-966624695a0d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:45.041806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bc1bdf2a-9a2c-49d1-a443-efc56969d372 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:45.053732 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1bbb66ba-3471-4ff3-8323-966624695a0d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:45.055494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bc1bdf2a-9a2c-49d1-a443-efc56969d372 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:45.065307 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bc1bdf2a-9a2c-49d1-a443-efc56969d372 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:45.070653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bc1bdf2a-9a2c-49d1-a443-efc56969d372 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:45.070653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bc1bdf2a-9a2c-49d1-a443-efc56969d372 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:45.070653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bc1bdf2a-9a2c-49d1-a443-efc56969d372 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:45.070972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1bbb66ba-3471-4ff3-8323-966624695a0d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.193798 Jul 18 16:50:45.070972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 44/93] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:44 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:45.231107 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-80213d3b-acc0-494e-b704-6d0ecfc6c464 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:45.231934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-80213d3b-acc0-494e-b704-6d0ecfc6c464 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:45.249686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80213d3b-acc0-494e-b704-6d0ecfc6c464 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:45.250407 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80213d3b-acc0-494e-b704-6d0ecfc6c464 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:45.251212 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80213d3b-acc0-494e-b704-6d0ecfc6c464 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:45.251656 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80213d3b-acc0-494e-b704-6d0ecfc6c464 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:45.259299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-bc1bdf2a-9a2c-49d1-a443-efc56969d372 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:45.267659 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bc1bdf2a-9a2c-49d1-a443-efc56969d372 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.229809 Jul 18 16:50:45.269214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 50/94] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:45 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:45.466960 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-80213d3b-acc0-494e-b704-6d0ecfc6c464 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:45.475734 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-80213d3b-acc0-494e-b704-6d0ecfc6c464 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.254689 Jul 18 16:50:45.480926 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 45/95] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:45 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:46.089974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-fdf915d9-350b-425e-b314-8df676a5405a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:46.091097 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-fdf915d9-350b-425e-b314-8df676a5405a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:46.101129 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:46.108088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf915d9-350b-425e-b314-8df676a5405a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:46.108694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf915d9-350b-425e-b314-8df676a5405a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:46.109615 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf915d9-350b-425e-b314-8df676a5405a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:46.110282 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf915d9-350b-425e-b314-8df676a5405a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:46.285632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2f24d08b-3c83-4564-ab1d-bef5cf2b1c4c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:46.286464 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2f24d08b-3c83-4564-ab1d-bef5cf2b1c4c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:46.298324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f24d08b-3c83-4564-ab1d-bef5cf2b1c4c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:46.298820 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f24d08b-3c83-4564-ab1d-bef5cf2b1c4c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:46.300201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f24d08b-3c83-4564-ab1d-bef5cf2b1c4c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:46.300735 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f24d08b-3c83-4564-ab1d-bef5cf2b1c4c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:46.303171 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-fdf915d9-350b-425e-b314-8df676a5405a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:46.312537 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-fdf915d9-350b-425e-b314-8df676a5405a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.231597 Jul 18 16:50:46.313545 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 51/96] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:46 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:46.494652 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4831e576-a2e8-44db-92f5-71897a817769 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:46.495592 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4831e576-a2e8-44db-92f5-71897a817769 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:46.504213 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4831e576-a2e8-44db-92f5-71897a817769 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:46.504864 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4831e576-a2e8-44db-92f5-71897a817769 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:46.505686 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4831e576-a2e8-44db-92f5-71897a817769 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:46.506130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4831e576-a2e8-44db-92f5-71897a817769 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:46.553209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2f24d08b-3c83-4564-ab1d-bef5cf2b1c4c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:46.563702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2f24d08b-3c83-4564-ab1d-bef5cf2b1c4c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.281958 Jul 18 16:50:46.564341 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 46/97] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:46 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:46.682334 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4831e576-a2e8-44db-92f5-71897a817769 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:46.694622 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4831e576-a2e8-44db-92f5-71897a817769 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.204831 Jul 18 16:50:46.699357 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 52/98] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:46 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:47.329262 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1deb8ef2-a5ea-4abb-8421-550f619da01d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:47.329867 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1deb8ef2-a5ea-4abb-8421-550f619da01d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:47.336136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1deb8ef2-a5ea-4abb-8421-550f619da01d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:47.336581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1deb8ef2-a5ea-4abb-8421-550f619da01d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:47.337373 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1deb8ef2-a5ea-4abb-8421-550f619da01d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:47.338068 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1deb8ef2-a5ea-4abb-8421-550f619da01d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:47.476469 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1deb8ef2-a5ea-4abb-8421-550f619da01d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:47.481793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1deb8ef2-a5ea-4abb-8421-550f619da01d tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.156344 Jul 18 16:50:47.482371 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 47/99] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:47 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:47.592455 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-936efaec-0fb7-4137-9555-70e3e97368e7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:47.592455 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-936efaec-0fb7-4137-9555-70e3e97368e7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:47.592455 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-936efaec-0fb7-4137-9555-70e3e97368e7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:47.593278 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-936efaec-0fb7-4137-9555-70e3e97368e7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:47.593717 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-936efaec-0fb7-4137-9555-70e3e97368e7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:47.594144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-936efaec-0fb7-4137-9555-70e3e97368e7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:47.711782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-19aa5e4b-cfe8-428d-acfa-44ff33f6e5d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:47.712406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-19aa5e4b-cfe8-428d-acfa-44ff33f6e5d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:47.718992 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-19aa5e4b-cfe8-428d-acfa-44ff33f6e5d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:47.719650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-19aa5e4b-cfe8-428d-acfa-44ff33f6e5d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:47.720446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-19aa5e4b-cfe8-428d-acfa-44ff33f6e5d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:47.720917 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-19aa5e4b-cfe8-428d-acfa-44ff33f6e5d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:47.741221 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-936efaec-0fb7-4137-9555-70e3e97368e7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:47.748847 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-936efaec-0fb7-4137-9555-70e3e97368e7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.170439 Jul 18 16:50:47.749451 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 53/100] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:47 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:47.853145 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-19aa5e4b-cfe8-428d-acfa-44ff33f6e5d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:47.860488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-19aa5e4b-cfe8-428d-acfa-44ff33f6e5d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.152848 Jul 18 16:50:47.861169 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 48/101] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:47 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:48.499470 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-830abfc5-d309-4ae9-9eb3-637ae79a62d5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:48.500210 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-830abfc5-d309-4ae9-9eb3-637ae79a62d5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:48.506989 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-830abfc5-d309-4ae9-9eb3-637ae79a62d5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:48.507436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-830abfc5-d309-4ae9-9eb3-637ae79a62d5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:48.508229 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-830abfc5-d309-4ae9-9eb3-637ae79a62d5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:48.508665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-830abfc5-d309-4ae9-9eb3-637ae79a62d5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:48.644386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-830abfc5-d309-4ae9-9eb3-637ae79a62d5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:48.647861 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:48.652356 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-830abfc5-d309-4ae9-9eb3-637ae79a62d5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.156710 Jul 18 16:50:48.653050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 54/102] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:48 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:48.765766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6667d02e-69c8-4a3c-93ae-454569da8117 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:48.766363 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6667d02e-69c8-4a3c-93ae-454569da8117 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:48.772944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6667d02e-69c8-4a3c-93ae-454569da8117 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:48.773417 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6667d02e-69c8-4a3c-93ae-454569da8117 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:48.774167 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6667d02e-69c8-4a3c-93ae-454569da8117 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:48.774599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6667d02e-69c8-4a3c-93ae-454569da8117 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:48.878529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e4264446-5982-47c9-90c2-08e6d4319971 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:48.879178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e4264446-5982-47c9-90c2-08e6d4319971 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:48.886026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e4264446-5982-47c9-90c2-08e6d4319971 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:48.886483 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e4264446-5982-47c9-90c2-08e6d4319971 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:48.887253 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e4264446-5982-47c9-90c2-08e6d4319971 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:48.887762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e4264446-5982-47c9-90c2-08e6d4319971 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:48.903535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6667d02e-69c8-4a3c-93ae-454569da8117 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:48.911689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6667d02e-69c8-4a3c-93ae-454569da8117 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.149751 Jul 18 16:50:48.912271 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 49/103] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:48 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:49.021934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e4264446-5982-47c9-90c2-08e6d4319971 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:49.029593 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e4264446-5982-47c9-90c2-08e6d4319971 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.155010 Jul 18 16:50:49.030203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 55/104] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:48 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:49.678074 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0e5a5817-b871-44c9-8cce-bb828b8ed543 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:49.678882 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0e5a5817-b871-44c9-8cce-bb828b8ed543 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:49.685559 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e5a5817-b871-44c9-8cce-bb828b8ed543 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:49.686012 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e5a5817-b871-44c9-8cce-bb828b8ed543 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:49.687001 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e5a5817-b871-44c9-8cce-bb828b8ed543 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:49.687578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e5a5817-b871-44c9-8cce-bb828b8ed543 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:49.841087 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0e5a5817-b871-44c9-8cce-bb828b8ed543 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:49.848710 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0e5a5817-b871-44c9-8cce-bb828b8ed543 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.175586 Jul 18 16:50:49.849322 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 50/105] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:49 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:49.930124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d9c9a67f-de8f-4928-938a-5ce11a71e208 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:49.930727 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d9c9a67f-de8f-4928-938a-5ce11a71e208 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:49.937218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d9c9a67f-de8f-4928-938a-5ce11a71e208 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:49.937699 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d9c9a67f-de8f-4928-938a-5ce11a71e208 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:49.938436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d9c9a67f-de8f-4928-938a-5ce11a71e208 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:49.938862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d9c9a67f-de8f-4928-938a-5ce11a71e208 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:50.048914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1fc739ed-e851-422e-b103-4a255af11e92 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:50.049693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1fc739ed-e851-422e-b103-4a255af11e92 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:50.057209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1fc739ed-e851-422e-b103-4a255af11e92 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:50.060254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1fc739ed-e851-422e-b103-4a255af11e92 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:50.060254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1fc739ed-e851-422e-b103-4a255af11e92 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:50.060254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1fc739ed-e851-422e-b103-4a255af11e92 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:50.073848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d9c9a67f-de8f-4928-938a-5ce11a71e208 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:50.082318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d9c9a67f-de8f-4928-938a-5ce11a71e208 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.156914 Jul 18 16:50:50.082994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 56/106] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:49 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:50.196224 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1fc739ed-e851-422e-b103-4a255af11e92 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:50.203789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1fc739ed-e851-422e-b103-4a255af11e92 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.158767 Jul 18 16:50:50.204360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 51/107] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:50 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:50.866027 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-81eb7d3a-a974-4abe-8e27-6caed40a6ad0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:50.866632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-81eb7d3a-a974-4abe-8e27-6caed40a6ad0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:50.872743 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-81eb7d3a-a974-4abe-8e27-6caed40a6ad0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:50.873240 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-81eb7d3a-a974-4abe-8e27-6caed40a6ad0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:50.874009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-81eb7d3a-a974-4abe-8e27-6caed40a6ad0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:50.874448 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-81eb7d3a-a974-4abe-8e27-6caed40a6ad0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:51.010394 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-81eb7d3a-a974-4abe-8e27-6caed40a6ad0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:51.017993 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-81eb7d3a-a974-4abe-8e27-6caed40a6ad0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.156258 Jul 18 16:50:51.018564 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 57/108] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:50 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:51.099763 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e0fbf7ae-788c-433e-97d4-71f1472dbe09 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:51.100380 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e0fbf7ae-788c-433e-97d4-71f1472dbe09 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:51.102538 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:51.107753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e0fbf7ae-788c-433e-97d4-71f1472dbe09 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:51.108144 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e0fbf7ae-788c-433e-97d4-71f1472dbe09 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:51.108933 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e0fbf7ae-788c-433e-97d4-71f1472dbe09 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:51.109372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e0fbf7ae-788c-433e-97d4-71f1472dbe09 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:51.220473 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e9e441ef-d04b-4e98-86be-872ad5465368 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:51.222094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e9e441ef-d04b-4e98-86be-872ad5465368 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:51.227531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e9e441ef-d04b-4e98-86be-872ad5465368 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:51.228093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e9e441ef-d04b-4e98-86be-872ad5465368 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:51.228762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e9e441ef-d04b-4e98-86be-872ad5465368 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:51.229301 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e9e441ef-d04b-4e98-86be-872ad5465368 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:51.242491 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e0fbf7ae-788c-433e-97d4-71f1472dbe09 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:51.250164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e0fbf7ae-788c-433e-97d4-71f1472dbe09 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.154394 Jul 18 16:50:51.250849 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 52/109] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:51 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:51.386248 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e9e441ef-d04b-4e98-86be-872ad5465368 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:51.394079 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e9e441ef-d04b-4e98-86be-872ad5465368 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.177433 Jul 18 16:50:51.394648 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 58/110] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:51 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:52.035409 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a05b3a34-fe0d-45b3-8324-d36caab42aea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:52.036013 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a05b3a34-fe0d-45b3-8324-d36caab42aea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:52.042845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a05b3a34-fe0d-45b3-8324-d36caab42aea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:52.043293 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a05b3a34-fe0d-45b3-8324-d36caab42aea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:52.044058 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a05b3a34-fe0d-45b3-8324-d36caab42aea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:52.044499 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a05b3a34-fe0d-45b3-8324-d36caab42aea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:52.048584 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=100 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:52.223375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a05b3a34-fe0d-45b3-8324-d36caab42aea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:52.230842 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a05b3a34-fe0d-45b3-8324-d36caab42aea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.199273 Jul 18 16:50:52.231417 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 53/111] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:52 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:52.268651 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b259b03d-8a0d-4f55-85ec-032ed102d7b4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:52.269292 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b259b03d-8a0d-4f55-85ec-032ed102d7b4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:52.275997 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b259b03d-8a0d-4f55-85ec-032ed102d7b4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:52.276443 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b259b03d-8a0d-4f55-85ec-032ed102d7b4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:52.277226 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b259b03d-8a0d-4f55-85ec-032ed102d7b4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:52.277666 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b259b03d-8a0d-4f55-85ec-032ed102d7b4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:52.411431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a9338a63-2b81-4c2b-9d87-31bb85a823d1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:52.413095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a9338a63-2b81-4c2b-9d87-31bb85a823d1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:52.417882 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b259b03d-8a0d-4f55-85ec-032ed102d7b4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:52.421177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a9338a63-2b81-4c2b-9d87-31bb85a823d1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:52.421876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a9338a63-2b81-4c2b-9d87-31bb85a823d1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:52.424578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a9338a63-2b81-4c2b-9d87-31bb85a823d1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:52.425211 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a9338a63-2b81-4c2b-9d87-31bb85a823d1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:52.426317 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b259b03d-8a0d-4f55-85ec-032ed102d7b4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.161396 Jul 18 16:50:52.427301 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 59/112] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:52 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:52.571144 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a9338a63-2b81-4c2b-9d87-31bb85a823d1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:52.578497 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a9338a63-2b81-4c2b-9d87-31bb85a823d1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.171672 Jul 18 16:50:52.579060 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 54/113] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:52 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:53.246664 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a2915e90-7d7f-4a71-a2fe-794194b8bc59 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:53.247269 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a2915e90-7d7f-4a71-a2fe-794194b8bc59 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:53.253285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2915e90-7d7f-4a71-a2fe-794194b8bc59 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:53.253754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2915e90-7d7f-4a71-a2fe-794194b8bc59 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:53.254521 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2915e90-7d7f-4a71-a2fe-794194b8bc59 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:53.255573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2915e90-7d7f-4a71-a2fe-794194b8bc59 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:53.390599 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a2915e90-7d7f-4a71-a2fe-794194b8bc59 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:53.398476 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a2915e90-7d7f-4a71-a2fe-794194b8bc59 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.155593 Jul 18 16:50:53.399071 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 60/114] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:53 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:53.443777 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-80cf4954-d970-4d25-8f05-99a5deb05e61 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:53.450518 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-80cf4954-d970-4d25-8f05-99a5deb05e61 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:53.450518 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80cf4954-d970-4d25-8f05-99a5deb05e61 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:53.450895 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80cf4954-d970-4d25-8f05-99a5deb05e61 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:53.451700 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80cf4954-d970-4d25-8f05-99a5deb05e61 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:53.452154 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80cf4954-d970-4d25-8f05-99a5deb05e61 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:53.595344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8d5d2cc9-3422-4233-a762-7dfb6fb98b00 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:53.595794 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-80cf4954-d970-4d25-8f05-99a5deb05e61 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:53.596190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8d5d2cc9-3422-4233-a762-7dfb6fb98b00 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:53.603136 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8d5d2cc9-3422-4233-a762-7dfb6fb98b00 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:53.605947 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8d5d2cc9-3422-4233-a762-7dfb6fb98b00 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:53.605947 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8d5d2cc9-3422-4233-a762-7dfb6fb98b00 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:53.605947 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8d5d2cc9-3422-4233-a762-7dfb6fb98b00 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:53.606209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-80cf4954-d970-4d25-8f05-99a5deb05e61 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.166274 Jul 18 16:50:53.606737 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 55/115] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:53 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:53.770949 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8d5d2cc9-3422-4233-a762-7dfb6fb98b00 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:53.780024 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8d5d2cc9-3422-4233-a762-7dfb6fb98b00 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.188386 Jul 18 16:50:53.781285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 61/116] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:53 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:54.415207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fbef0373-c1e8-45eb-b028-191ada8bab6b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:54.415826 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fbef0373-c1e8-45eb-b028-191ada8bab6b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:54.422136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fbef0373-c1e8-45eb-b028-191ada8bab6b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:54.422592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fbef0373-c1e8-45eb-b028-191ada8bab6b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:54.423375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fbef0373-c1e8-45eb-b028-191ada8bab6b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:54.423814 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fbef0373-c1e8-45eb-b028-191ada8bab6b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:54.610950 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-fbef0373-c1e8-45eb-b028-191ada8bab6b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:54.625924 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-40fab7d2-f9af-4d0e-8226-2a9225dcc8fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:54.626549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-40fab7d2-f9af-4d0e-8226-2a9225dcc8fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:54.641186 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-40fab7d2-f9af-4d0e-8226-2a9225dcc8fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:54.641939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-40fab7d2-f9af-4d0e-8226-2a9225dcc8fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:54.642890 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-40fab7d2-f9af-4d0e-8226-2a9225dcc8fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:54.646488 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-40fab7d2-f9af-4d0e-8226-2a9225dcc8fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:54.652603 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fbef0373-c1e8-45eb-b028-191ada8bab6b tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.236644 Jul 18 16:50:54.652603 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 56/117] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:54 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:54.798400 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2226b4f8-d8c4-4fff-b6df-b242e171abba tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:54.799170 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2226b4f8-d8c4-4fff-b6df-b242e171abba tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:54.807157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2226b4f8-d8c4-4fff-b6df-b242e171abba tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:54.808697 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2226b4f8-d8c4-4fff-b6df-b242e171abba tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:54.810000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2226b4f8-d8c4-4fff-b6df-b242e171abba tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:54.810622 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2226b4f8-d8c4-4fff-b6df-b242e171abba tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:54.864500 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-40fab7d2-f9af-4d0e-8226-2a9225dcc8fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:54.874505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-40fab7d2-f9af-4d0e-8226-2a9225dcc8fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.254202 Jul 18 16:50:54.875513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 62/118] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:54 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:55.234972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2226b4f8-d8c4-4fff-b6df-b242e171abba tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:55.245746 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2226b4f8-d8c4-4fff-b6df-b242e171abba tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.452132 Jul 18 16:50:55.246845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 57/119] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:54 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:55.667275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-833920e2-1723-4d49-8b15-e843bf7163ea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:55.670367 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-833920e2-1723-4d49-8b15-e843bf7163ea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:55.679307 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-833920e2-1723-4d49-8b15-e843bf7163ea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.680070 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-833920e2-1723-4d49-8b15-e843bf7163ea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.681604 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-833920e2-1723-4d49-8b15-e843bf7163ea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.682234 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-833920e2-1723-4d49-8b15-e843bf7163ea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.892392 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-19ddde36-af34-4da8-8ab1-ea597299ccc4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:55.893991 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-19ddde36-af34-4da8-8ab1-ea597299ccc4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:55.907809 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-19ddde36-af34-4da8-8ab1-ea597299ccc4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.911718 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-19ddde36-af34-4da8-8ab1-ea597299ccc4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.916254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-19ddde36-af34-4da8-8ab1-ea597299ccc4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:55.917464 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-19ddde36-af34-4da8-8ab1-ea597299ccc4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:55.930192 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-833920e2-1723-4d49-8b15-e843bf7163ea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:55.946652 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-833920e2-1723-4d49-8b15-e843bf7163ea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.283194 Jul 18 16:50:55.947336 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 63/120] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:55 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:56.262444 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-408cd01f-2011-460d-99b3-5609ecf33dd0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:56.263060 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-408cd01f-2011-460d-99b3-5609ecf33dd0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:56.278602 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-408cd01f-2011-460d-99b3-5609ecf33dd0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:56.279270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-408cd01f-2011-460d-99b3-5609ecf33dd0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:56.280285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-408cd01f-2011-460d-99b3-5609ecf33dd0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:56.280931 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-408cd01f-2011-460d-99b3-5609ecf33dd0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:56.424861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-19ddde36-af34-4da8-8ab1-ea597299ccc4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:56.438780 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-19ddde36-af34-4da8-8ab1-ea597299ccc4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.550011 Jul 18 16:50:56.439675 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 58/121] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:55 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:56.488578 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-408cd01f-2011-460d-99b3-5609ecf33dd0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:56.505609 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-408cd01f-2011-460d-99b3-5609ecf33dd0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.246576 Jul 18 16:50:56.514930 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 64/122] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:56 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:56.965790 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fa5cd51a-5376-40fb-9b97-d70d6993b490 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:56.966387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fa5cd51a-5376-40fb-9b97-d70d6993b490 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:56.972763 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fa5cd51a-5376-40fb-9b97-d70d6993b490 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:56.973244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fa5cd51a-5376-40fb-9b97-d70d6993b490 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:56.976013 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fa5cd51a-5376-40fb-9b97-d70d6993b490 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:56.976478 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fa5cd51a-5376-40fb-9b97-d70d6993b490 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:57.131132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-fa5cd51a-5376-40fb-9b97-d70d6993b490 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:57.139923 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fa5cd51a-5376-40fb-9b97-d70d6993b490 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.178318 Jul 18 16:50:57.140717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 59/123] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:56 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:57.459117 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7cc3366e-8d87-4a01-9e8a-8deb915bfebf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:57.460218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7cc3366e-8d87-4a01-9e8a-8deb915bfebf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:57.470462 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7cc3366e-8d87-4a01-9e8a-8deb915bfebf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:57.471189 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7cc3366e-8d87-4a01-9e8a-8deb915bfebf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:57.472438 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7cc3366e-8d87-4a01-9e8a-8deb915bfebf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:57.473198 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7cc3366e-8d87-4a01-9e8a-8deb915bfebf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:57.524247 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-aa3ac4c6-e00b-4d5f-b230-2a62fc61e68f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:57.525157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-aa3ac4c6-e00b-4d5f-b230-2a62fc61e68f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:57.531450 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4c6-e00b-4d5f-b230-2a62fc61e68f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:57.535911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4c6-e00b-4d5f-b230-2a62fc61e68f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:57.535911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4c6-e00b-4d5f-b230-2a62fc61e68f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:57.535911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4c6-e00b-4d5f-b230-2a62fc61e68f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:57.662798 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7cc3366e-8d87-4a01-9e8a-8deb915bfebf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:57.669786 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7cc3366e-8d87-4a01-9e8a-8deb915bfebf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.217387 Jul 18 16:50:57.672930 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 65/124] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:57 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:57.712767 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-aa3ac4c6-e00b-4d5f-b230-2a62fc61e68f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:57.720293 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-aa3ac4c6-e00b-4d5f-b230-2a62fc61e68f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.201366 Jul 18 16:50:57.720936 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 60/125] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:57 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:58.157549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f44aeb83-c872-44a2-898e-6be11a811bea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:58.158470 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f44aeb83-c872-44a2-898e-6be11a811bea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:58.165250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f44aeb83-c872-44a2-898e-6be11a811bea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:58.165774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f44aeb83-c872-44a2-898e-6be11a811bea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:58.166567 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f44aeb83-c872-44a2-898e-6be11a811bea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:58.167005 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f44aeb83-c872-44a2-898e-6be11a811bea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:58.299820 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f44aeb83-c872-44a2-898e-6be11a811bea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:58.308003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f44aeb83-c872-44a2-898e-6be11a811bea tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.155519 Jul 18 16:50:58.309069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 66/126] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:58 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:58.687006 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a6e25727-c409-4661-b575-84e3613596ce tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:58.687734 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a6e25727-c409-4661-b575-84e3613596ce tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:58.693852 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a6e25727-c409-4661-b575-84e3613596ce tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:58.694299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a6e25727-c409-4661-b575-84e3613596ce tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:58.695064 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a6e25727-c409-4661-b575-84e3613596ce tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:58.695495 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a6e25727-c409-4661-b575-84e3613596ce tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:58.740288 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-21422012-c794-481c-aecd-b7df784e8a2b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:58.741014 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-21422012-c794-481c-aecd-b7df784e8a2b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:58.747220 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-21422012-c794-481c-aecd-b7df784e8a2b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:58.754141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-21422012-c794-481c-aecd-b7df784e8a2b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:58.754141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-21422012-c794-481c-aecd-b7df784e8a2b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:58.754141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-21422012-c794-481c-aecd-b7df784e8a2b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:58.837320 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a6e25727-c409-4661-b575-84e3613596ce tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:58.845519 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a6e25727-c409-4661-b575-84e3613596ce tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.162328 Jul 18 16:50:58.847670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 61/127] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:58 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:58.893507 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-21422012-c794-481c-aecd-b7df784e8a2b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:58.902797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-21422012-c794-481c-aecd-b7df784e8a2b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.168234 Jul 18 16:50:58.902797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 67/128] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:58 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:50:59.329671 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-dbf73bb5-1e61-4194-bb59-fd439377aac4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:59.329671 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-dbf73bb5-1e61-4194-bb59-fd439377aac4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:59.343599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbf73bb5-1e61-4194-bb59-fd439377aac4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:59.344087 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbf73bb5-1e61-4194-bb59-fd439377aac4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:59.345466 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbf73bb5-1e61-4194-bb59-fd439377aac4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:59.346281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbf73bb5-1e61-4194-bb59-fd439377aac4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:59.520926 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-dbf73bb5-1e61-4194-bb59-fd439377aac4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:50:59.534767 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-dbf73bb5-1e61-4194-bb59-fd439377aac4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.208484 Jul 18 16:50:59.534767 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 62/129] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:59 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:50:59.868656 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5d0658ce-1d3a-4ec3-bb9c-d55b8786fcff tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:59.869300 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5d0658ce-1d3a-4ec3-bb9c-d55b8786fcff tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:59.875604 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d0658ce-1d3a-4ec3-bb9c-d55b8786fcff tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:59.876058 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d0658ce-1d3a-4ec3-bb9c-d55b8786fcff tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:59.876833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d0658ce-1d3a-4ec3-bb9c-d55b8786fcff tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:59.877337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d0658ce-1d3a-4ec3-bb9c-d55b8786fcff tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:59.918119 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9d85e1da-b400-4fa2-84ba-24b5e6311111 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:50:59.918718 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9d85e1da-b400-4fa2-84ba-24b5e6311111 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:50:59.924920 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9d85e1da-b400-4fa2-84ba-24b5e6311111 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:59.925624 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9d85e1da-b400-4fa2-84ba-24b5e6311111 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:59.927440 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9d85e1da-b400-4fa2-84ba-24b5e6311111 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:50:59.927888 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9d85e1da-b400-4fa2-84ba-24b5e6311111 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:00.048357 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5d0658ce-1d3a-4ec3-bb9c-d55b8786fcff tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:00.057846 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5d0658ce-1d3a-4ec3-bb9c-d55b8786fcff tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.194146 Jul 18 16:51:00.058448 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 68/130] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:59 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:00.106051 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9d85e1da-b400-4fa2-84ba-24b5e6311111 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:00.114384 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9d85e1da-b400-4fa2-84ba-24b5e6311111 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.199984 Jul 18 16:51:00.114985 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 63/131] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:50:59 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:00.556561 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f4262bc4-d686-4aae-87ca-e59eac5c0fc1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:00.557709 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f4262bc4-d686-4aae-87ca-e59eac5c0fc1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:00.565860 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4262bc4-d686-4aae-87ca-e59eac5c0fc1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:00.566652 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4262bc4-d686-4aae-87ca-e59eac5c0fc1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:00.568263 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4262bc4-d686-4aae-87ca-e59eac5c0fc1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:00.568806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4262bc4-d686-4aae-87ca-e59eac5c0fc1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:00.751975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f4262bc4-d686-4aae-87ca-e59eac5c0fc1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:00.760518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f4262bc4-d686-4aae-87ca-e59eac5c0fc1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.210846 Jul 18 16:51:00.761513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 69/132] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:00 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:01.075519 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a81003fd-1c4c-485f-a830-212da2afc99b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:01.076122 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a81003fd-1c4c-485f-a830-212da2afc99b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:01.082240 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a81003fd-1c4c-485f-a830-212da2afc99b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:01.083348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a81003fd-1c4c-485f-a830-212da2afc99b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:01.084269 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a81003fd-1c4c-485f-a830-212da2afc99b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:01.084709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a81003fd-1c4c-485f-a830-212da2afc99b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:01.131624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-57732364-8ce0-48fa-bd8b-7e81ae301996 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:01.132244 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-57732364-8ce0-48fa-bd8b-7e81ae301996 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:01.138608 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-57732364-8ce0-48fa-bd8b-7e81ae301996 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:01.139143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-57732364-8ce0-48fa-bd8b-7e81ae301996 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:01.139984 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-57732364-8ce0-48fa-bd8b-7e81ae301996 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:01.140491 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-57732364-8ce0-48fa-bd8b-7e81ae301996 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:01.291382 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a81003fd-1c4c-485f-a830-212da2afc99b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:01.300796 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a81003fd-1c4c-485f-a830-212da2afc99b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.229222 Jul 18 16:51:01.301411 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 64/133] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:01 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:01.335554 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-57732364-8ce0-48fa-bd8b-7e81ae301996 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:01.343961 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-57732364-8ce0-48fa-bd8b-7e81ae301996 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.216778 Jul 18 16:51:01.344775 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 70/134] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:01 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:01.776938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-267b088e-98d8-4026-b349-8fc0c0adcac5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:01.777550 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-267b088e-98d8-4026-b349-8fc0c0adcac5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:01.783588 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-267b088e-98d8-4026-b349-8fc0c0adcac5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:01.784261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-267b088e-98d8-4026-b349-8fc0c0adcac5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:01.785538 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-267b088e-98d8-4026-b349-8fc0c0adcac5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:01.786437 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-267b088e-98d8-4026-b349-8fc0c0adcac5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:01.967919 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-267b088e-98d8-4026-b349-8fc0c0adcac5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:01.977249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-267b088e-98d8-4026-b349-8fc0c0adcac5 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.204202 Jul 18 16:51:01.977893 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 65/135] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:01 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:02.281631 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-0fe13b9a-576e-490a-9e81-b7f6d6df7b73 req-9dbffc8c-5a27-4283-874d-631ae1efe91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3a0d59-9562-45d0-befc-fc63474db543", "name": "network-vif-plugged", "status": "completed", "tag": "76d4d124-f5eb-4620-a0fa-4acc7c98e2ec"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:02.292330 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-0fe13b9a-576e-490a-9e81-b7f6d6df7b73 req-9dbffc8c-5a27-4283-874d-631ae1efe91b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:02.293082 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-0fe13b9a-576e-490a-9e81-b7f6d6df7b73 req-9dbffc8c-5a27-4283-874d-631ae1efe91b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:02.306274 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-0fe13b9a-576e-490a-9e81-b7f6d6df7b73 req-9dbffc8c-5a27-4283-874d-631ae1efe91b service nova] Creating event network-vif-plugged:76d4d124-f5eb-4620-a0fa-4acc7c98e2ec for instance 6d3a0d59-9562-45d0-befc-fc63474db543 on hv-cinder-84617 Jul 18 16:51:02.312065 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-0fe13b9a-576e-490a-9e81-b7f6d6df7b73 req-9dbffc8c-5a27-4283-874d-631ae1efe91b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091791 Jul 18 16:51:02.312938 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 71/136] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:02.318339 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0da78f3b-a0d4-4678-b763-b5770569f17c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:02.318988 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0da78f3b-a0d4-4678-b763-b5770569f17c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:02.325533 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0da78f3b-a0d4-4678-b763-b5770569f17c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:02.325879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0da78f3b-a0d4-4678-b763-b5770569f17c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:02.326726 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0da78f3b-a0d4-4678-b763-b5770569f17c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:02.327081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0da78f3b-a0d4-4678-b763-b5770569f17c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:02.364968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1191b608-c0be-44b3-82be-5cda3bb75ba8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:02.366402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1191b608-c0be-44b3-82be-5cda3bb75ba8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:02.376901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1191b608-c0be-44b3-82be-5cda3bb75ba8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:02.377726 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1191b608-c0be-44b3-82be-5cda3bb75ba8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:02.378515 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1191b608-c0be-44b3-82be-5cda3bb75ba8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:02.378961 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1191b608-c0be-44b3-82be-5cda3bb75ba8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:02.385519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:02.562948 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0da78f3b-a0d4-4678-b763-b5770569f17c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:02.570922 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0da78f3b-a0d4-4678-b763-b5770569f17c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.256106 Jul 18 16:51:02.571611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 66/137] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:02 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:02.623249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1191b608-c0be-44b3-82be-5cda3bb75ba8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:02.633862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1191b608-c0be-44b3-82be-5cda3bb75ba8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.275788 Jul 18 16:51:02.634907 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 72/138] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:02 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:02.994343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a8fc307e-5639-4480-9154-4c1fa3f94482 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:02.995229 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a8fc307e-5639-4480-9154-4c1fa3f94482 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:03.001274 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a8fc307e-5639-4480-9154-4c1fa3f94482 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:03.006693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a8fc307e-5639-4480-9154-4c1fa3f94482 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:03.006693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a8fc307e-5639-4480-9154-4c1fa3f94482 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:03.006693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a8fc307e-5639-4480-9154-4c1fa3f94482 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:03.160307 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a8fc307e-5639-4480-9154-4c1fa3f94482 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:03.171171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a8fc307e-5639-4480-9154-4c1fa3f94482 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.180488 Jul 18 16:51:03.171774 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 67/139] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:02 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:03.588716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b53a1e26-d051-4a68-8524-87e85376cb9c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:03.589562 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b53a1e26-d051-4a68-8524-87e85376cb9c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:03.595985 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b53a1e26-d051-4a68-8524-87e85376cb9c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:03.604994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b53a1e26-d051-4a68-8524-87e85376cb9c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:03.604994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b53a1e26-d051-4a68-8524-87e85376cb9c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:03.604994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b53a1e26-d051-4a68-8524-87e85376cb9c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:03.651024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b90a0fd0-b185-48a6-af64-51e05bdb9e51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:03.652149 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b90a0fd0-b185-48a6-af64-51e05bdb9e51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:03.660276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b90a0fd0-b185-48a6-af64-51e05bdb9e51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:03.661327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b90a0fd0-b185-48a6-af64-51e05bdb9e51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:03.662151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b90a0fd0-b185-48a6-af64-51e05bdb9e51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:03.662591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b90a0fd0-b185-48a6-af64-51e05bdb9e51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:03.753682 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b53a1e26-d051-4a68-8524-87e85376cb9c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:03.765061 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b53a1e26-d051-4a68-8524-87e85376cb9c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.181037 Jul 18 16:51:03.765937 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 73/140] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:03 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:03.838010 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b90a0fd0-b185-48a6-af64-51e05bdb9e51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:03.855025 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b90a0fd0-b185-48a6-af64-51e05bdb9e51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.204295 Jul 18 16:51:03.855797 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 68/141] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:03 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:04.188515 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-77016136-2cfd-4774-a032-9a9c5efe5fe3 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:04.189214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-77016136-2cfd-4774-a032-9a9c5efe5fe3 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:04.196152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-77016136-2cfd-4774-a032-9a9c5efe5fe3 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:04.196722 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-77016136-2cfd-4774-a032-9a9c5efe5fe3 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:04.197524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-77016136-2cfd-4774-a032-9a9c5efe5fe3 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:04.198447 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-77016136-2cfd-4774-a032-9a9c5efe5fe3 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:04.340104 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-d7db13c6-eff9-4c55-99d3-d3111600132b req-c4f95811-3bc4-4370-9b0e-d9388ec717ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961bdca6-9130-4433-86dc-657618b53284", "name": "network-vif-plugged", "status": "completed", "tag": "62fdbe46-c000-4272-99a3-12a2a443665b"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:04.366098 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-d7db13c6-eff9-4c55-99d3-d3111600132b req-c4f95811-3bc4-4370-9b0e-d9388ec717ac service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:04.366584 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-d7db13c6-eff9-4c55-99d3-d3111600132b req-c4f95811-3bc4-4370-9b0e-d9388ec717ac service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:04.367283 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-77016136-2cfd-4774-a032-9a9c5efe5fe3 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:04.376066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-77016136-2cfd-4774-a032-9a9c5efe5fe3 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.191499 Jul 18 16:51:04.376654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 74/142] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:04 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:04.389813 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-d7db13c6-eff9-4c55-99d3-d3111600132b req-c4f95811-3bc4-4370-9b0e-d9388ec717ac service nova] Creating event network-vif-plugged:62fdbe46-c000-4272-99a3-12a2a443665b for instance 961bdca6-9130-4433-86dc-657618b53284 on hv-cinder-84617 Jul 18 16:51:04.396446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-d7db13c6-eff9-4c55-99d3-d3111600132b req-c4f95811-3bc4-4370-9b0e-d9388ec717ac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061524 Jul 18 16:51:04.397198 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 69/143] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:51:04.785409 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7025ac1c-9cb8-4054-88bb-0584d246a2cd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:04.786614 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7025ac1c-9cb8-4054-88bb-0584d246a2cd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:04.792951 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7025ac1c-9cb8-4054-88bb-0584d246a2cd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:04.793413 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7025ac1c-9cb8-4054-88bb-0584d246a2cd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:04.794188 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7025ac1c-9cb8-4054-88bb-0584d246a2cd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:04.794628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7025ac1c-9cb8-4054-88bb-0584d246a2cd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:04.873987 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7281e7e8-9c24-4f28-a895-1fb66f83cb73 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:04.875343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7281e7e8-9c24-4f28-a895-1fb66f83cb73 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:04.886931 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7281e7e8-9c24-4f28-a895-1fb66f83cb73 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:04.887800 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7281e7e8-9c24-4f28-a895-1fb66f83cb73 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:04.889871 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7281e7e8-9c24-4f28-a895-1fb66f83cb73 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:04.891423 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7281e7e8-9c24-4f28-a895-1fb66f83cb73 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:04.949037 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=100 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:05.042905 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7025ac1c-9cb8-4054-88bb-0584d246a2cd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:05.052066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7025ac1c-9cb8-4054-88bb-0584d246a2cd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.271955 Jul 18 16:51:05.053042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 75/144] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:04 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:05.256549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7281e7e8-9c24-4f28-a895-1fb66f83cb73 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:05.267758 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7281e7e8-9c24-4f28-a895-1fb66f83cb73 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.399056 Jul 18 16:51:05.268439 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 70/145] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:04 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:05.399066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-32d26db4-5df2-416f-9fa9-50cc2f5ebfc9 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:05.400077 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-32d26db4-5df2-416f-9fa9-50cc2f5ebfc9 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:05.411156 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-32d26db4-5df2-416f-9fa9-50cc2f5ebfc9 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:05.411908 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-32d26db4-5df2-416f-9fa9-50cc2f5ebfc9 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:05.413105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-32d26db4-5df2-416f-9fa9-50cc2f5ebfc9 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:05.413726 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-32d26db4-5df2-416f-9fa9-50cc2f5ebfc9 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:05.565755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-32d26db4-5df2-416f-9fa9-50cc2f5ebfc9 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:05.576009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-32d26db4-5df2-416f-9fa9-50cc2f5ebfc9 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.180494 Jul 18 16:51:05.577210 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 76/146] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:05 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:06.071682 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7973b0ff-cc8c-4242-b292-0911140accee tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:06.073329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7973b0ff-cc8c-4242-b292-0911140accee tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:06.081993 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7973b0ff-cc8c-4242-b292-0911140accee tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:06.084009 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7973b0ff-cc8c-4242-b292-0911140accee tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:06.085481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7973b0ff-cc8c-4242-b292-0911140accee tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:06.086155 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7973b0ff-cc8c-4242-b292-0911140accee tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:06.287765 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d662d075-56e4-44b3-803a-1145a684a150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:06.289709 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d662d075-56e4-44b3-803a-1145a684a150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:06.297242 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d662d075-56e4-44b3-803a-1145a684a150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:06.297533 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7973b0ff-cc8c-4242-b292-0911140accee tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:06.298092 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d662d075-56e4-44b3-803a-1145a684a150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:06.299052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d662d075-56e4-44b3-803a-1145a684a150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:06.299483 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d662d075-56e4-44b3-803a-1145a684a150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:06.306047 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7973b0ff-cc8c-4242-b292-0911140accee tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.240157 Jul 18 16:51:06.306626 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 71/147] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:06 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:06.482378 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d662d075-56e4-44b3-803a-1145a684a150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:06.491374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d662d075-56e4-44b3-803a-1145a684a150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.210375 Jul 18 16:51:06.491957 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 77/148] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:06 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:06.606848 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f58cdae4-186f-4eea-ac23-1761ecd7fc4a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:06.607488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f58cdae4-186f-4eea-ac23-1761ecd7fc4a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:06.619387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f58cdae4-186f-4eea-ac23-1761ecd7fc4a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:06.619838 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f58cdae4-186f-4eea-ac23-1761ecd7fc4a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:06.622485 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f58cdae4-186f-4eea-ac23-1761ecd7fc4a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:06.623389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f58cdae4-186f-4eea-ac23-1761ecd7fc4a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:06.780045 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f58cdae4-186f-4eea-ac23-1761ecd7fc4a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:06.788434 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f58cdae4-186f-4eea-ac23-1761ecd7fc4a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.193482 Jul 18 16:51:06.789053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 72/149] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:06 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:07.325817 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-85d88e34-a1e3-413b-bc02-95d0442d0fa4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:07.326552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-85d88e34-a1e3-413b-bc02-95d0442d0fa4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:07.334885 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85d88e34-a1e3-413b-bc02-95d0442d0fa4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.335329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85d88e34-a1e3-413b-bc02-95d0442d0fa4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.336505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85d88e34-a1e3-413b-bc02-95d0442d0fa4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.336968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85d88e34-a1e3-413b-bc02-95d0442d0fa4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.508924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ae034812-684f-4b52-8f70-4453f95be81a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:07.509545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ae034812-684f-4b52-8f70-4453f95be81a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:07.516433 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ae034812-684f-4b52-8f70-4453f95be81a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.517071 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ae034812-684f-4b52-8f70-4453f95be81a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.518210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ae034812-684f-4b52-8f70-4453f95be81a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.518804 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ae034812-684f-4b52-8f70-4453f95be81a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.624015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-85d88e34-a1e3-413b-bc02-95d0442d0fa4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:07.637596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-85d88e34-a1e3-413b-bc02-95d0442d0fa4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.317351 Jul 18 16:51:07.638531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 78/150] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:07 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:07.662559 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ae034812-684f-4b52-8f70-4453f95be81a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:07.670892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ae034812-684f-4b52-8f70-4453f95be81a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.166900 Jul 18 16:51:07.671468 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 73/151] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:07 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:07.813661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cc582ece-764b-4e86-bad3-59aaccd49f1a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:07.815022 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cc582ece-764b-4e86-bad3-59aaccd49f1a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:07.819014 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=79 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:07.826352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc582ece-764b-4e86-bad3-59aaccd49f1a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.826850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc582ece-764b-4e86-bad3-59aaccd49f1a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.827674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc582ece-764b-4e86-bad3-59aaccd49f1a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.828440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc582ece-764b-4e86-bad3-59aaccd49f1a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.994137 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-cc582ece-764b-4e86-bad3-59aaccd49f1a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:08.001719 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cc582ece-764b-4e86-bad3-59aaccd49f1a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.196113 Jul 18 16:51:08.002297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 79/152] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:07 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:08.655949 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-634f44c2-4004-491c-984a-0f6b669bddca tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:08.656532 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-634f44c2-4004-491c-984a-0f6b669bddca tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:08.658409 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=76 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:08.663236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-634f44c2-4004-491c-984a-0f6b669bddca tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.663674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-634f44c2-4004-491c-984a-0f6b669bddca tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:08.664441 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-634f44c2-4004-491c-984a-0f6b669bddca tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.664867 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-634f44c2-4004-491c-984a-0f6b669bddca tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:08.687471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e65cf22b-bb30-4b74-8831-0afccfe748b0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:08.688164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e65cf22b-bb30-4b74-8831-0afccfe748b0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:08.694979 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e65cf22b-bb30-4b74-8831-0afccfe748b0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.695432 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e65cf22b-bb30-4b74-8831-0afccfe748b0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:08.696202 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e65cf22b-bb30-4b74-8831-0afccfe748b0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.696638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e65cf22b-bb30-4b74-8831-0afccfe748b0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:08.839739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e65cf22b-bb30-4b74-8831-0afccfe748b0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:08.850855 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e65cf22b-bb30-4b74-8831-0afccfe748b0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.167035 Jul 18 16:51:08.855815 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 80/153] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:08 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:08.875942 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-634f44c2-4004-491c-984a-0f6b669bddca tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:08.886741 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-634f44c2-4004-491c-984a-0f6b669bddca tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.234524 Jul 18 16:51:08.887395 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 74/154] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:08 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:09.018927 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1b899c4a-bbb6-4b7c-a4f8-68173c6a9fa8 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:09.019533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1b899c4a-bbb6-4b7c-a4f8-68173c6a9fa8 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:09.026238 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1b899c4a-bbb6-4b7c-a4f8-68173c6a9fa8 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.026689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1b899c4a-bbb6-4b7c-a4f8-68173c6a9fa8 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.027459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1b899c4a-bbb6-4b7c-a4f8-68173c6a9fa8 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.027890 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1b899c4a-bbb6-4b7c-a4f8-68173c6a9fa8 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.176280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1b899c4a-bbb6-4b7c-a4f8-68173c6a9fa8 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:09.186145 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1b899c4a-bbb6-4b7c-a4f8-68173c6a9fa8 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.169844 Jul 18 16:51:09.186833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 81/155] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:09 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:09.404160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-95ef18bd-e025-453c-82e8-06e3d7ad2526 req-c16f71b1-36d3-42b2-9fe1-4d998b83a489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0acf48-1262-4cbc-98dc-562510f2cc10", "name": "network-vif-plugged", "status": "completed", "tag": "e24ea19f-20d4-44b1-8b36-327ccde66e88"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:09.419248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-95ef18bd-e025-453c-82e8-06e3d7ad2526 req-c16f71b1-36d3-42b2-9fe1-4d998b83a489 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.420042 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-95ef18bd-e025-453c-82e8-06e3d7ad2526 req-c16f71b1-36d3-42b2-9fe1-4d998b83a489 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.435791 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-95ef18bd-e025-453c-82e8-06e3d7ad2526 req-c16f71b1-36d3-42b2-9fe1-4d998b83a489 service nova] Creating event network-vif-plugged:e24ea19f-20d4-44b1-8b36-327ccde66e88 for instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 on hv-cinder-84617 Jul 18 16:51:09.442849 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-95ef18bd-e025-453c-82e8-06e3d7ad2526 req-c16f71b1-36d3-42b2-9fe1-4d998b83a489 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042804 Jul 18 16:51:09.443395 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 75/156] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:09.872327 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-30acda05-6d56-4658-9c98-b999865cab17 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:09.872327 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-30acda05-6d56-4658-9c98-b999865cab17 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:09.878731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-30acda05-6d56-4658-9c98-b999865cab17 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.879188 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-30acda05-6d56-4658-9c98-b999865cab17 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.880584 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-30acda05-6d56-4658-9c98-b999865cab17 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.882645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-30acda05-6d56-4658-9c98-b999865cab17 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.904140 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-583b2839-700e-424c-8b2b-ebc6216f2754 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:09.904835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-583b2839-700e-424c-8b2b-ebc6216f2754 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:09.911676 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-583b2839-700e-424c-8b2b-ebc6216f2754 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.912128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-583b2839-700e-424c-8b2b-ebc6216f2754 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.912924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-583b2839-700e-424c-8b2b-ebc6216f2754 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:09.913388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-583b2839-700e-424c-8b2b-ebc6216f2754 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.034496 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-30acda05-6d56-4658-9c98-b999865cab17 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:10.042307 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-30acda05-6d56-4658-9c98-b999865cab17 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.174997 Jul 18 16:51:10.043325 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 82/157] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:09 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:10.083004 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-583b2839-700e-424c-8b2b-ebc6216f2754 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:10.091381 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-583b2839-700e-424c-8b2b-ebc6216f2754 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.191393 Jul 18 16:51:10.092060 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 76/158] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:09 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:10.204258 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cf25cbb8-de83-4e93-82ec-0deccb2627c2 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:10.204668 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cf25cbb8-de83-4e93-82ec-0deccb2627c2 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:10.212105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cf25cbb8-de83-4e93-82ec-0deccb2627c2 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:10.218809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cf25cbb8-de83-4e93-82ec-0deccb2627c2 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.220061 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cf25cbb8-de83-4e93-82ec-0deccb2627c2 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:10.220438 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cf25cbb8-de83-4e93-82ec-0deccb2627c2 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.399042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-cf25cbb8-de83-4e93-82ec-0deccb2627c2 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:10.408782 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cf25cbb8-de83-4e93-82ec-0deccb2627c2 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1315 microversion: 2.1 time: 0.209170 Jul 18 16:51:10.409782 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 83/159] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:10 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:11.068348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a1741e86-df65-4930-8e58-9e8f320638ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:11.069490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a1741e86-df65-4930-8e58-9e8f320638ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:11.082368 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a1741e86-df65-4930-8e58-9e8f320638ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:11.084181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a1741e86-df65-4930-8e58-9e8f320638ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:11.085733 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a1741e86-df65-4930-8e58-9e8f320638ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:11.086526 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a1741e86-df65-4930-8e58-9e8f320638ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:11.111643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e507c80c-9eee-4d1f-9469-8e79bb3a8b34 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:11.111643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e507c80c-9eee-4d1f-9469-8e79bb3a8b34 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:11.119339 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e507c80c-9eee-4d1f-9469-8e79bb3a8b34 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:11.119809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e507c80c-9eee-4d1f-9469-8e79bb3a8b34 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:11.120642 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e507c80c-9eee-4d1f-9469-8e79bb3a8b34 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:11.121275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e507c80c-9eee-4d1f-9469-8e79bb3a8b34 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:11.321177 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e507c80c-9eee-4d1f-9469-8e79bb3a8b34 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:11.343896 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e507c80c-9eee-4d1f-9469-8e79bb3a8b34 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.228537 Jul 18 16:51:11.343896 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 84/160] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:11 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:11.378820 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a1741e86-df65-4930-8e58-9e8f320638ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:11.390525 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a1741e86-df65-4930-8e58-9e8f320638ed tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1322 microversion: 2.1 time: 0.333276 Jul 18 16:51:11.391429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 77/161] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:11 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:11.429175 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5c2c95ad-65e5-4e37-b795-f12dc9964157 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:11.429961 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5c2c95ad-65e5-4e37-b795-f12dc9964157 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:11.435990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5c2c95ad-65e5-4e37-b795-f12dc9964157 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:11.436446 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5c2c95ad-65e5-4e37-b795-f12dc9964157 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:11.437247 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5c2c95ad-65e5-4e37-b795-f12dc9964157 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:11.437684 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5c2c95ad-65e5-4e37-b795-f12dc9964157 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:11.601570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5c2c95ad-65e5-4e37-b795-f12dc9964157 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:11.612321 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5c2c95ad-65e5-4e37-b795-f12dc9964157 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1503 microversion: 2.1 time: 0.187514 Jul 18 16:51:11.612973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 85/162] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:11 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:12.356911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7e46b622-dfb0-43eb-9165-a0b8f0eabf58 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:12.357679 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7e46b622-dfb0-43eb-9165-a0b8f0eabf58 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:12.383686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7e46b622-dfb0-43eb-9165-a0b8f0eabf58 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.384686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7e46b622-dfb0-43eb-9165-a0b8f0eabf58 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.390361 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7e46b622-dfb0-43eb-9165-a0b8f0eabf58 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.393192 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7e46b622-dfb0-43eb-9165-a0b8f0eabf58 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.409565 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-08c51b7d-5459-4146-873e-a7cf35821e45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:12.410247 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-08c51b7d-5459-4146-873e-a7cf35821e45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:12.420085 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-08c51b7d-5459-4146-873e-a7cf35821e45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.427357 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-08c51b7d-5459-4146-873e-a7cf35821e45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.428402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-08c51b7d-5459-4146-873e-a7cf35821e45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.429839 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-08c51b7d-5459-4146-873e-a7cf35821e45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.783593 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7e46b622-dfb0-43eb-9165-a0b8f0eabf58 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:12.804467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7e46b622-dfb0-43eb-9165-a0b8f0eabf58 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.452758 Jul 18 16:51:12.805121 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 78/163] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:12 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:12.816775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-1dd5ee2c-55c0-4a71-a837-58805b25ec78 req-8983339f-60d3-4edd-9c6b-7e5f265a834d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67187e3-9b84-4393-a7bf-c15db8b715ee", "name": "network-vif-plugged", "status": "completed", "tag": "52949cd4-aff2-4ec9-8946-76ec43bfca3e"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:12.820975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-08c51b7d-5459-4146-873e-a7cf35821e45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:12.830289 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-08c51b7d-5459-4146-873e-a7cf35821e45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1516 microversion: 2.1 time: 0.424932 Jul 18 16:51:12.834005 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-1dd5ee2c-55c0-4a71-a837-58805b25ec78 req-8983339f-60d3-4edd-9c6b-7e5f265a834d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.834236 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 86/164] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:12 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1516 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:12.834541 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-1dd5ee2c-55c0-4a71-a837-58805b25ec78 req-8983339f-60d3-4edd-9c6b-7e5f265a834d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.854463 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-16df3892-d11d-45ae-a881-3291fc387a3d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:12.855834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-16df3892-d11d-45ae-a881-3291fc387a3d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:12.865735 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-16df3892-d11d-45ae-a881-3291fc387a3d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.866190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-16df3892-d11d-45ae-a881-3291fc387a3d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.866975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-16df3892-d11d-45ae-a881-3291fc387a3d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.869142 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-1dd5ee2c-55c0-4a71-a837-58805b25ec78 req-8983339f-60d3-4edd-9c6b-7e5f265a834d service nova] Creating event network-vif-plugged:52949cd4-aff2-4ec9-8946-76ec43bfca3e for instance e67187e3-9b84-4393-a7bf-c15db8b715ee on hv-cinder-84617 Jul 18 16:51:12.876225 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-16df3892-d11d-45ae-a881-3291fc387a3d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.878981 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-1dd5ee2c-55c0-4a71-a837-58805b25ec78 req-8983339f-60d3-4edd-9c6b-7e5f265a834d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071223 Jul 18 16:51:12.881900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 79/165] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:12.946812 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-16df3892-d11d-45ae-a881-3291fc387a3d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'flavor' on Instance uuid 961bdca6-9130-4433-86dc-657618b53284 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:51:13.100058 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:13.374762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-16df3892-d11d-45ae-a881-3291fc387a3d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284/action" status: 200 len: 32 microversion: 2.1 time: 0.519526 Jul 18 16:51:13.374762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 87/166] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:51:12 2022] POST /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284/action => generated 32 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 16:51:13.392324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-65c0eb8e-0339-4dc2-ae1f-8753ace02dca tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:13.396465 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-65c0eb8e-0339-4dc2-ae1f-8753ace02dca tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:13.413862 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-65c0eb8e-0339-4dc2-ae1f-8753ace02dca tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:13.413862 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-65c0eb8e-0339-4dc2-ae1f-8753ace02dca tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:13.413862 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-65c0eb8e-0339-4dc2-ae1f-8753ace02dca tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:13.413862 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-65c0eb8e-0339-4dc2-ae1f-8753ace02dca tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:13.581249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-65c0eb8e-0339-4dc2-ae1f-8753ace02dca tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:13.591812 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-65c0eb8e-0339-4dc2-ae1f-8753ace02dca tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.212345 Jul 18 16:51:13.604322 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 80/167] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:13 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:13.831790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-07e5eee7-2c3c-4485-81d6-e2393feb4559 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:13.831790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-07e5eee7-2c3c-4485-81d6-e2393feb4559 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:13.839728 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-07e5eee7-2c3c-4485-81d6-e2393feb4559 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:13.840174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-07e5eee7-2c3c-4485-81d6-e2393feb4559 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:13.840985 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-07e5eee7-2c3c-4485-81d6-e2393feb4559 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:13.841859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-07e5eee7-2c3c-4485-81d6-e2393feb4559 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:14.018426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-07e5eee7-2c3c-4485-81d6-e2393feb4559 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:14.027256 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-07e5eee7-2c3c-4485-81d6-e2393feb4559 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.206323 Jul 18 16:51:14.027833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 88/168] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:13 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:14.616125 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-eccd4c78-ae90-47a0-a355-c5e95013547a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:14.619082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-eccd4c78-ae90-47a0-a355-c5e95013547a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:14.628651 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eccd4c78-ae90-47a0-a355-c5e95013547a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:14.629415 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eccd4c78-ae90-47a0-a355-c5e95013547a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:14.630384 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eccd4c78-ae90-47a0-a355-c5e95013547a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:14.631222 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eccd4c78-ae90-47a0-a355-c5e95013547a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:15.045528 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1ca8b7df-407d-4880-a986-7dbb9f8218ac tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:15.046143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1ca8b7df-407d-4880-a986-7dbb9f8218ac tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:15.053015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1ca8b7df-407d-4880-a986-7dbb9f8218ac tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:15.053478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1ca8b7df-407d-4880-a986-7dbb9f8218ac tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:15.054254 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1ca8b7df-407d-4880-a986-7dbb9f8218ac tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:15.054689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1ca8b7df-407d-4880-a986-7dbb9f8218ac tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:15.127676 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-eccd4c78-ae90-47a0-a355-c5e95013547a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:15.140874 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-eccd4c78-ae90-47a0-a355-c5e95013547a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.534893 Jul 18 16:51:15.142276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 81/169] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:14 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:15.445177 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1ca8b7df-407d-4880-a986-7dbb9f8218ac tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:15.453684 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1ca8b7df-407d-4880-a986-7dbb9f8218ac tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.412360 Jul 18 16:51:15.472597 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2c67fb16-b99f-4d60-be5b-baea0be8f5c0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32d4fe76-5c92-4e58-823d-441a075eb5ab"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:15.474488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2c67fb16-b99f-4d60-be5b-baea0be8f5c0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:15.501077 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 89/170] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:15 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:15.501967 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2c67fb16-b99f-4d60-be5b-baea0be8f5c0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:15.501967 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2c67fb16-b99f-4d60-be5b-baea0be8f5c0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:15.501967 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2c67fb16-b99f-4d60-be5b-baea0be8f5c0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:15.501967 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2c67fb16-b99f-4d60-be5b-baea0be8f5c0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:16.164351 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-15c72f15-ddd3-4500-b39c-015f14e56415 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:16.168607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-15c72f15-ddd3-4500-b39c-015f14e56415 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:16.191511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-15c72f15-ddd3-4500-b39c-015f14e56415 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:16.195367 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-15c72f15-ddd3-4500-b39c-015f14e56415 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:16.196258 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-15c72f15-ddd3-4500-b39c-015f14e56415 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:16.211889 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-15c72f15-ddd3-4500-b39c-015f14e56415 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:16.455986 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-15c72f15-ddd3-4500-b39c-015f14e56415 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:16.465585 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-15c72f15-ddd3-4500-b39c-015f14e56415 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.309130 Jul 18 16:51:16.484991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 90/171] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:16 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:16.484991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b04bb216-9ef0-4bc8-be53-e396dc4e6053 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:16.484991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b04bb216-9ef0-4bc8-be53-e396dc4e6053 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:16.486079 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b04bb216-9ef0-4bc8-be53-e396dc4e6053 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:16.486918 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b04bb216-9ef0-4bc8-be53-e396dc4e6053 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:16.488109 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b04bb216-9ef0-4bc8-be53-e396dc4e6053 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:16.490091 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b04bb216-9ef0-4bc8-be53-e396dc4e6053 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:16.717548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b04bb216-9ef0-4bc8-be53-e396dc4e6053 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:16.725530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b04bb216-9ef0-4bc8-be53-e396dc4e6053 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1363 microversion: 2.1 time: 0.253626 Jul 18 16:51:16.726208 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 91/172] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:16 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:17.492667 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d8663d82-fdd3-45ff-b3b0-76c767e66544 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:17.493354 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d8663d82-fdd3-45ff-b3b0-76c767e66544 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:17.499400 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d8663d82-fdd3-45ff-b3b0-76c767e66544 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:17.499854 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d8663d82-fdd3-45ff-b3b0-76c767e66544 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:17.500618 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d8663d82-fdd3-45ff-b3b0-76c767e66544 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:17.501089 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d8663d82-fdd3-45ff-b3b0-76c767e66544 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:17.661385 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d8663d82-fdd3-45ff-b3b0-76c767e66544 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:17.666574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d8663d82-fdd3-45ff-b3b0-76c767e66544 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.178281 Jul 18 16:51:17.667155 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 92/173] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:17 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:17.744407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-eba9f4f8-1e1c-42ec-bcc0-c462e71c967b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:17.745670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-eba9f4f8-1e1c-42ec-bcc0-c462e71c967b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:17.752645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eba9f4f8-1e1c-42ec-bcc0-c462e71c967b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:17.753126 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eba9f4f8-1e1c-42ec-bcc0-c462e71c967b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:17.753974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eba9f4f8-1e1c-42ec-bcc0-c462e71c967b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:17.754501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eba9f4f8-1e1c-42ec-bcc0-c462e71c967b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:17.901280 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2c67fb16-b99f-4d60-be5b-baea0be8f5c0 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "POST /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.432522 Jul 18 16:51:17.903992 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 82/174] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:51:15 2022] POST /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543/os-volume_attachments => generated 194 bytes in 2436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:17.915526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-eba9f4f8-1e1c-42ec-bcc0-c462e71c967b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:17.924476 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-eba9f4f8-1e1c-42ec-bcc0-c462e71c967b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1548 microversion: 2.1 time: 0.184675 Jul 18 16:51:17.927619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 93/175] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:17 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:17.948371 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-698ea16a-3e1f-4cb0-b5aa-230b36fb11ef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:17.948975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-698ea16a-3e1f-4cb0-b5aa-230b36fb11ef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:17.955522 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-698ea16a-3e1f-4cb0-b5aa-230b36fb11ef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:17.955975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-698ea16a-3e1f-4cb0-b5aa-230b36fb11ef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:17.957111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-698ea16a-3e1f-4cb0-b5aa-230b36fb11ef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:17.958070 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-698ea16a-3e1f-4cb0-b5aa-230b36fb11ef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:18.057954 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-698ea16a-3e1f-4cb0-b5aa-230b36fb11ef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113779 Jul 18 16:51:18.058661 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 83/176] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 16:51:17 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:18.692363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9ce59510-9c6c-4dc6-997d-6049f75c5f79 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:18.693532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9ce59510-9c6c-4dc6-997d-6049f75c5f79 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:18.705874 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9ce59510-9c6c-4dc6-997d-6049f75c5f79 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:18.707936 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9ce59510-9c6c-4dc6-997d-6049f75c5f79 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:18.708919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9ce59510-9c6c-4dc6-997d-6049f75c5f79 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:18.709495 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9ce59510-9c6c-4dc6-997d-6049f75c5f79 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:18.923989 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9ce59510-9c6c-4dc6-997d-6049f75c5f79 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:18.933936 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9ce59510-9c6c-4dc6-997d-6049f75c5f79 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.244804 Jul 18 16:51:18.936249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 94/177] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:18 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:19.821597 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-796dd099-8a96-4942-a54f-e251db3a2f6f req-9c367c70-0b20-4619-ac9d-a9b22a84f2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67187e3-9b84-4393-a7bf-c15db8b715ee", "tag": "52949cd4-aff2-4ec9-8946-76ec43bfca3e"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:19.831022 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-796dd099-8a96-4942-a54f-e251db3a2f6f req-9c367c70-0b20-4619-ac9d-a9b22a84f2fc service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:19.831480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-796dd099-8a96-4942-a54f-e251db3a2f6f req-9c367c70-0b20-4619-ac9d-a9b22a84f2fc service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:19.844216 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-796dd099-8a96-4942-a54f-e251db3a2f6f req-9c367c70-0b20-4619-ac9d-a9b22a84f2fc service nova] Creating event network-changed:52949cd4-aff2-4ec9-8946-76ec43bfca3e for instance e67187e3-9b84-4393-a7bf-c15db8b715ee on hv-cinder-84617 Jul 18 16:51:19.849753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-796dd099-8a96-4942-a54f-e251db3a2f6f req-9c367c70-0b20-4619-ac9d-a9b22a84f2fc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032345 Jul 18 16:51:19.850654 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 84/178] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:19.956979 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-63194e6e-9a3d-442f-9f6c-274a9c24afe6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:19.958168 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-63194e6e-9a3d-442f-9f6c-274a9c24afe6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:19.964708 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-63194e6e-9a3d-442f-9f6c-274a9c24afe6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:19.965123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-63194e6e-9a3d-442f-9f6c-274a9c24afe6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:19.965912 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-63194e6e-9a3d-442f-9f6c-274a9c24afe6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:19.966353 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-63194e6e-9a3d-442f-9f6c-274a9c24afe6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:20.110898 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-63194e6e-9a3d-442f-9f6c-274a9c24afe6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:20.119153 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-63194e6e-9a3d-442f-9f6c-274a9c24afe6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.166127 Jul 18 16:51:20.119931 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 95/179] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:19 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:21.143286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-07b9db43-fd25-4f0d-b549-9b097baad2fa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:21.143972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-07b9db43-fd25-4f0d-b549-9b097baad2fa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:21.150239 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-07b9db43-fd25-4f0d-b549-9b097baad2fa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:21.150784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-07b9db43-fd25-4f0d-b549-9b097baad2fa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:21.151436 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-07b9db43-fd25-4f0d-b549-9b097baad2fa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:21.151866 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-07b9db43-fd25-4f0d-b549-9b097baad2fa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:21.288779 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-07b9db43-fd25-4f0d-b549-9b097baad2fa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:21.296600 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-07b9db43-fd25-4f0d-b549-9b097baad2fa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.157967 Jul 18 16:51:21.300719 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 85/180] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:21 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:22.314178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-371a0caf-3163-462a-b3af-30035584b182 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:22.315321 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-371a0caf-3163-462a-b3af-30035584b182 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:22.324095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-371a0caf-3163-462a-b3af-30035584b182 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:22.324846 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-371a0caf-3163-462a-b3af-30035584b182 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:22.325770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-371a0caf-3163-462a-b3af-30035584b182 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:22.326298 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-371a0caf-3163-462a-b3af-30035584b182 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:22.469647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-371a0caf-3163-462a-b3af-30035584b182 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:22.477154 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-371a0caf-3163-462a-b3af-30035584b182 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.168177 Jul 18 16:51:22.477718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 96/181] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:22 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:23.493803 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fcad3a5a-5f58-472a-ae99-288809656909 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:23.494337 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fcad3a5a-5f58-472a-ae99-288809656909 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:23.501489 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fcad3a5a-5f58-472a-ae99-288809656909 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:23.501937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fcad3a5a-5f58-472a-ae99-288809656909 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:23.502701 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fcad3a5a-5f58-472a-ae99-288809656909 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:23.503139 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fcad3a5a-5f58-472a-ae99-288809656909 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:23.640457 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-fcad3a5a-5f58-472a-ae99-288809656909 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:23.647966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fcad3a5a-5f58-472a-ae99-288809656909 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.158195 Jul 18 16:51:23.648542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 86/182] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:23 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:24.665118 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-62b765b8-89b9-4bb8-bfe3-3b48b30c1035 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:24.665720 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-62b765b8-89b9-4bb8-bfe3-3b48b30c1035 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:24.671910 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-62b765b8-89b9-4bb8-bfe3-3b48b30c1035 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:24.672368 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-62b765b8-89b9-4bb8-bfe3-3b48b30c1035 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:24.673205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-62b765b8-89b9-4bb8-bfe3-3b48b30c1035 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:24.673690 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-62b765b8-89b9-4bb8-bfe3-3b48b30c1035 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:24.823182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-62b765b8-89b9-4bb8-bfe3-3b48b30c1035 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:24.832051 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-62b765b8-89b9-4bb8-bfe3-3b48b30c1035 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.170741 Jul 18 16:51:24.837332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 97/183] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:24 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:25.852793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e323f1ee-a136-4e57-837c-7046be9be2d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:25.853544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e323f1ee-a136-4e57-837c-7046be9be2d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:25.860800 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e323f1ee-a136-4e57-837c-7046be9be2d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:25.861814 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e323f1ee-a136-4e57-837c-7046be9be2d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:25.862622 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e323f1ee-a136-4e57-837c-7046be9be2d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:25.863105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e323f1ee-a136-4e57-837c-7046be9be2d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:26.030723 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e323f1ee-a136-4e57-837c-7046be9be2d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:26.037568 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e323f1ee-a136-4e57-837c-7046be9be2d2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.188545 Jul 18 16:51:26.040913 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 87/184] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:25 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:27.054069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7360b815-fa9b-4ed0-99c6-dade0e0b40e2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:27.054725 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7360b815-fa9b-4ed0-99c6-dade0e0b40e2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:27.067674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7360b815-fa9b-4ed0-99c6-dade0e0b40e2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:27.075844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7360b815-fa9b-4ed0-99c6-dade0e0b40e2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:27.075844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7360b815-fa9b-4ed0-99c6-dade0e0b40e2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:27.075844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7360b815-fa9b-4ed0-99c6-dade0e0b40e2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:27.217839 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7360b815-fa9b-4ed0-99c6-dade0e0b40e2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:27.226861 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7360b815-fa9b-4ed0-99c6-dade0e0b40e2 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.176564 Jul 18 16:51:27.227551 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 98/185] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:27 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:28.244154 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-15f206e0-2c5f-406d-8ae0-b54f67df0f96 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:28.244892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-15f206e0-2c5f-406d-8ae0-b54f67df0f96 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:28.251412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-15f206e0-2c5f-406d-8ae0-b54f67df0f96 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:28.251852 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-15f206e0-2c5f-406d-8ae0-b54f67df0f96 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:28.252640 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-15f206e0-2c5f-406d-8ae0-b54f67df0f96 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:28.253120 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-15f206e0-2c5f-406d-8ae0-b54f67df0f96 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:28.259183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:28.428511 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-15f206e0-2c5f-406d-8ae0-b54f67df0f96 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:28.434272 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-15f206e0-2c5f-406d-8ae0-b54f67df0f96 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.193874 Jul 18 16:51:28.434950 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 88/186] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:28 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:29.451627 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-03907cd2-119f-4d13-a1f8-17694199364f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:29.452235 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-03907cd2-119f-4d13-a1f8-17694199364f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:29.461058 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-03907cd2-119f-4d13-a1f8-17694199364f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:29.461541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-03907cd2-119f-4d13-a1f8-17694199364f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:29.464026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-03907cd2-119f-4d13-a1f8-17694199364f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:29.464544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-03907cd2-119f-4d13-a1f8-17694199364f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:29.669307 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-03907cd2-119f-4d13-a1f8-17694199364f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:29.683907 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-03907cd2-119f-4d13-a1f8-17694199364f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.233569 Jul 18 16:51:29.685180 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 99/187] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:29 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:30.704919 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-33e6489a-ffb2-4094-aaa9-47f69a2c6150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:30.705509 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-33e6489a-ffb2-4094-aaa9-47f69a2c6150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:30.716015 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-33e6489a-ffb2-4094-aaa9-47f69a2c6150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:30.716941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-33e6489a-ffb2-4094-aaa9-47f69a2c6150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:30.717948 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-33e6489a-ffb2-4094-aaa9-47f69a2c6150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:30.729238 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-33e6489a-ffb2-4094-aaa9-47f69a2c6150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:31.067306 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-33e6489a-ffb2-4094-aaa9-47f69a2c6150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:31.078087 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-33e6489a-ffb2-4094-aaa9-47f69a2c6150 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.378661 Jul 18 16:51:31.087951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 89/188] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:30 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:32.095630 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-63b47abb-6433-4179-8218-ed90bee0135c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:32.096252 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-63b47abb-6433-4179-8218-ed90bee0135c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:32.103420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-63b47abb-6433-4179-8218-ed90bee0135c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:32.103859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-63b47abb-6433-4179-8218-ed90bee0135c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:32.105275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-63b47abb-6433-4179-8218-ed90bee0135c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:32.105720 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-63b47abb-6433-4179-8218-ed90bee0135c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:32.293466 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-63b47abb-6433-4179-8218-ed90bee0135c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:32.298390 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-63b47abb-6433-4179-8218-ed90bee0135c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.206519 Jul 18 16:51:32.299066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 100/189] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:32 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:32.593142 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3be766b6-99bc-479c-ace6-d9b5eb9beb30 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:32.594233 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3be766b6-99bc-479c-ace6-d9b5eb9beb30 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:32.605005 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3be766b6-99bc-479c-ace6-d9b5eb9beb30 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:32.605674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3be766b6-99bc-479c-ace6-d9b5eb9beb30 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:32.606754 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3be766b6-99bc-479c-ace6-d9b5eb9beb30 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:32.607885 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3be766b6-99bc-479c-ace6-d9b5eb9beb30 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:32.638176 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3be766b6-99bc-479c-ace6-d9b5eb9beb30 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:51:33.033274 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3be766b6-99bc-479c-ace6-d9b5eb9beb30 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 204 len: 0 microversion: 2.1 time: 0.444209 Jul 18 16:51:33.033880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 90/190] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:51:32 2022] DELETE /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:51:33.062752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-68421766-2020-48d6-aa8c-e3a19d6baaf4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:33.063719 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-68421766-2020-48d6-aa8c-e3a19d6baaf4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:33.088005 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68421766-2020-48d6-aa8c-e3a19d6baaf4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:33.088769 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68421766-2020-48d6-aa8c-e3a19d6baaf4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:33.089812 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68421766-2020-48d6-aa8c-e3a19d6baaf4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:33.090423 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68421766-2020-48d6-aa8c-e3a19d6baaf4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:33.245890 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-68421766-2020-48d6-aa8c-e3a19d6baaf4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:33.255340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-68421766-2020-48d6-aa8c-e3a19d6baaf4 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1555 microversion: 2.1 time: 0.210951 Jul 18 16:51:33.261586 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 101/191] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:33 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:33.319861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a78d0850-f44a-4e3e-8a83-20d6e0bf4369 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:33.325146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a78d0850-f44a-4e3e-8a83-20d6e0bf4369 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:33.349965 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a78d0850-f44a-4e3e-8a83-20d6e0bf4369 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:33.351854 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a78d0850-f44a-4e3e-8a83-20d6e0bf4369 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:33.353339 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a78d0850-f44a-4e3e-8a83-20d6e0bf4369 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:33.354041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a78d0850-f44a-4e3e-8a83-20d6e0bf4369 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:33.913354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a78d0850-f44a-4e3e-8a83-20d6e0bf4369 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:33.924635 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a78d0850-f44a-4e3e-8a83-20d6e0bf4369 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.611602 Jul 18 16:51:33.934972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 91/192] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:33 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:34.274916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d1f40df0-2fee-4782-b815-02f3f4dcf29a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:34.276039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d1f40df0-2fee-4782-b815-02f3f4dcf29a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:34.282552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1f40df0-2fee-4782-b815-02f3f4dcf29a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:34.283354 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1f40df0-2fee-4782-b815-02f3f4dcf29a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:34.284125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1f40df0-2fee-4782-b815-02f3f4dcf29a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:34.284588 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1f40df0-2fee-4782-b815-02f3f4dcf29a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:34.532001 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d1f40df0-2fee-4782-b815-02f3f4dcf29a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:34.542419 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d1f40df0-2fee-4782-b815-02f3f4dcf29a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1555 microversion: 2.1 time: 0.271176 Jul 18 16:51:34.545040 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 102/193] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:34 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1555 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:34.946095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bea84fdd-7d94-40c3-98a6-07b9e78a5ec9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:34.948188 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-bea84fdd-7d94-40c3-98a6-07b9e78a5ec9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:34.960004 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bea84fdd-7d94-40c3-98a6-07b9e78a5ec9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:34.961637 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bea84fdd-7d94-40c3-98a6-07b9e78a5ec9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:34.963687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bea84fdd-7d94-40c3-98a6-07b9e78a5ec9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:34.965567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bea84fdd-7d94-40c3-98a6-07b9e78a5ec9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:35.280741 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-bea84fdd-7d94-40c3-98a6-07b9e78a5ec9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:35.294195 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-bea84fdd-7d94-40c3-98a6-07b9e78a5ec9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.352368 Jul 18 16:51:35.294974 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 92/194] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:34 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:35.562362 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b615fefc-5b63-418c-98ca-746234f714d1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:35.562362 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b615fefc-5b63-418c-98ca-746234f714d1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:35.572853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b615fefc-5b63-418c-98ca-746234f714d1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:35.574146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b615fefc-5b63-418c-98ca-746234f714d1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:35.581633 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b615fefc-5b63-418c-98ca-746234f714d1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:35.581633 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b615fefc-5b63-418c-98ca-746234f714d1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:35.657235 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:35.853099 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b615fefc-5b63-418c-98ca-746234f714d1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:35.874653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b615fefc-5b63-418c-98ca-746234f714d1 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1555 microversion: 2.1 time: 0.318704 Jul 18 16:51:35.887539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 103/195] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:35 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1555 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:36.310765 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f51ffb31-c25e-4fed-b8f1-04f484055028 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:36.312644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f51ffb31-c25e-4fed-b8f1-04f484055028 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:36.319016 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f51ffb31-c25e-4fed-b8f1-04f484055028 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.319359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f51ffb31-c25e-4fed-b8f1-04f484055028 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.320491 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f51ffb31-c25e-4fed-b8f1-04f484055028 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.321119 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f51ffb31-c25e-4fed-b8f1-04f484055028 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.895665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-337b503c-2183-4fb5-a852-68df3a5dce9a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:36.896287 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-337b503c-2183-4fb5-a852-68df3a5dce9a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:36.907136 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-337b503c-2183-4fb5-a852-68df3a5dce9a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.907598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-337b503c-2183-4fb5-a852-68df3a5dce9a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.908383 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-337b503c-2183-4fb5-a852-68df3a5dce9a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.908825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-337b503c-2183-4fb5-a852-68df3a5dce9a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.987492 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f51ffb31-c25e-4fed-b8f1-04f484055028 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:36.997280 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f51ffb31-c25e-4fed-b8f1-04f484055028 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.689057 Jul 18 16:51:37.002660 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 93/196] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:36 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:37.125853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-337b503c-2183-4fb5-a852-68df3a5dce9a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:37.134577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-337b503c-2183-4fb5-a852-68df3a5dce9a tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1555 microversion: 2.1 time: 0.243530 Jul 18 16:51:37.136570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 104/197] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:36 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:37.370448 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-67bf9047-012a-4d69-b798-3f30a4ac158c req-e5a2240a-5682-4f5b-8d34-1538cb6cfcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3a0d59-9562-45d0-befc-fc63474db543", "name": "network-vif-deleted", "tag": "76d4d124-f5eb-4620-a0fa-4acc7c98e2ec"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:37.395618 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-67bf9047-012a-4d69-b798-3f30a4ac158c req-e5a2240a-5682-4f5b-8d34-1538cb6cfcd2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:37.396645 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-67bf9047-012a-4d69-b798-3f30a4ac158c req-e5a2240a-5682-4f5b-8d34-1538cb6cfcd2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:37.429599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-67bf9047-012a-4d69-b798-3f30a4ac158c req-e5a2240a-5682-4f5b-8d34-1538cb6cfcd2 service nova] Creating event network-vif-deleted:76d4d124-f5eb-4620-a0fa-4acc7c98e2ec for instance 6d3a0d59-9562-45d0-befc-fc63474db543 on hv-cinder-84617 Jul 18 16:51:37.438398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-67bf9047-012a-4d69-b798-3f30a4ac158c req-e5a2240a-5682-4f5b-8d34-1538cb6cfcd2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074103 Jul 18 16:51:37.439631 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 94/198] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:38.026890 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7df8dc88-cc9f-4055-a418-a8674e3e1e5e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:38.026890 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7df8dc88-cc9f-4055-a418-a8674e3e1e5e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:38.033474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=52 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:38.038831 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7df8dc88-cc9f-4055-a418-a8674e3e1e5e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:38.040210 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7df8dc88-cc9f-4055-a418-a8674e3e1e5e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:38.042983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7df8dc88-cc9f-4055-a418-a8674e3e1e5e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:38.044270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7df8dc88-cc9f-4055-a418-a8674e3e1e5e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:38.155760 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2ba510ca-2736-4d86-9b1c-350800c0b779 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:38.156560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2ba510ca-2736-4d86-9b1c-350800c0b779 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:38.165436 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2ba510ca-2736-4d86-9b1c-350800c0b779 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:38.165917 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2ba510ca-2736-4d86-9b1c-350800c0b779 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:38.168620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2ba510ca-2736-4d86-9b1c-350800c0b779 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:38.169098 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2ba510ca-2736-4d86-9b1c-350800c0b779 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:38.273566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2ba510ca-2736-4d86-9b1c-350800c0b779 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:38.284253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2ba510ca-2736-4d86-9b1c-350800c0b779 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1346 microversion: 2.1 time: 0.133444 Jul 18 16:51:38.288027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 95/199] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:38 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:38.297001 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7df8dc88-cc9f-4055-a418-a8674e3e1e5e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:38.309504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7df8dc88-cc9f-4055-a418-a8674e3e1e5e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.295377 Jul 18 16:51:38.317222 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 105/200] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:38 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:39.305626 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:39.306512 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:39.319024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.320659 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.321711 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.325443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.330341 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-19b51ebd-897d-481b-aff6-d890c43b7154 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:39.331187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-19b51ebd-897d-481b-aff6-d890c43b7154 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:39.343757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-19b51ebd-897d-481b-aff6-d890c43b7154 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.345342 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-19b51ebd-897d-481b-aff6-d890c43b7154 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.346597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-19b51ebd-897d-481b-aff6-d890c43b7154 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.351189 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-19b51ebd-897d-481b-aff6-d890c43b7154 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.433713 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:39.444350 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.445243 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.446378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lazy-loading 'fault' on Instance uuid 6d3a0d59-9562-45d0-befc-fc63474db543 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:51:39.642702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baaf254c2b28444bab7f1c7cc3fbc42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61afdae54fc4f76b7dd31798c4226f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:39.665029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-265df7b7-5d20-4f36-8f06-0fa1c2e9a9aa tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 200 len: 1351 microversion: 2.1 time: 0.365008 Jul 18 16:51:39.681995 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 96/201] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:39 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 1351 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:39.766312 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-19b51ebd-897d-481b-aff6-d890c43b7154 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:39.777627 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-19b51ebd-897d-481b-aff6-d890c43b7154 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.452682 Jul 18 16:51:39.778654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 106/202] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:39 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:40.695743 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:40.696360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:40.704710 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.705191 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:40.710158 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.710688 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:40.756993 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] HTTP exception thrown: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Request method failure captured: Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 HTTP/1.1 Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y9Fr72RZtk4aHgvJFmUrITSuRa_dCKAFC4W2NCshF8YcYC-ix28NzJ2By4tM8XBJapdor4zi8nzoL3fWCPkwY0nQpwlra9x94KYgFk7Gbe7TKGzOYL6V9GaIXm67zzSDO8_VXI42poei6wEluo_6F4Wy20jYRqpWxVESmdebcD3YGo Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: b61afdae54fc4f76b7dd31798c4226f4 Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:51:40.769178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b61afdae54fc4f76b7dd31798c4226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b61afdae54fc4f76b7dd31798c4226f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b61afdae54fc4f76b7dd31798c4226f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b61afdae54fc4f76b7dd31798c4226f4"}]}] Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: b61afdae54fc4f76b7dd31798c4226f4 Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-DeleteServersTestJSON-896546155-project Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: baaf254c2b28444bab7f1c7cc3fbc42c Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-DeleteServersTestJSON-896546155-project Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:40.770460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '6d3a0d59-9562-45d0-befc-fc63474db543'} Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:40.771128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:40.772244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:40.773290 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Returning 404 to user: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:40.773290 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b85444fc-b45d-4157-a15d-e08c3a8453d7 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 404 len: 111 microversion: 2.1 time: 0.075596 Jul 18 16:51:40.773290 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 97/203] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:40 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:40.797404 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-52f9134c-76de-494d-ab19-d84a89a782c8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:40.797404 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-52f9134c-76de-494d-ab19-d84a89a782c8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:40.805060 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-52f9134c-76de-494d-ab19-d84a89a782c8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.805522 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-52f9134c-76de-494d-ab19-d84a89a782c8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:40.806473 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-52f9134c-76de-494d-ab19-d84a89a782c8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.807005 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-52f9134c-76de-494d-ab19-d84a89a782c8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.052677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:41.054168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:41.068747 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.069746 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.071254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.076303 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.097665 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] HTTP exception thrown: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Request method failure captured: Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543/os-volume_attachments HTTP/1.1 Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y9Fr72RZtk4aHgvJFmUrITSuRa_dCKAFC4W2NCshF8YcYC-ix28NzJ2By4tM8XBJapdor4zi8nzoL3fWCPkwY0nQpwlra9x94KYgFk7Gbe7TKGzOYL6V9GaIXm67zzSDO8_VXI42poei6wEluo_6F4Wy20jYRqpWxVESmdebcD3YGo Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: b61afdae54fc4f76b7dd31798c4226f4 Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:51:41.110336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b61afdae54fc4f76b7dd31798c4226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b61afdae54fc4f76b7dd31798c4226f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b61afdae54fc4f76b7dd31798c4226f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b61afdae54fc4f76b7dd31798c4226f4"}]}] Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: b61afdae54fc4f76b7dd31798c4226f4 Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-DeleteServersTestJSON-896546155-project Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: baaf254c2b28444bab7f1c7cc3fbc42c Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-DeleteServersTestJSON-896546155-project Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:41.113623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'server_id': '6d3a0d59-9562-45d0-befc-fc63474db543'} Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:41.114277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:41.117685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:51:41.121766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Returning 404 to user: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:41.122891 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ec69b7cf-0647-426f-8f96-313c4b8775bb tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.075190 Jul 18 16:51:41.127451 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 98/204] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:51:41 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:51:41.156042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-52f9134c-76de-494d-ab19-d84a89a782c8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:41.178357 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-52f9134c-76de-494d-ab19-d84a89a782c8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.386948 Jul 18 16:51:41.178949 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 107/205] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:40 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:42.197971 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-dbffb07d-41cd-481f-b15a-e383704db414 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:42.199050 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-dbffb07d-41cd-481f-b15a-e383704db414 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:42.215298 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbffb07d-41cd-481f-b15a-e383704db414 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.215748 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbffb07d-41cd-481f-b15a-e383704db414 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.216541 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbffb07d-41cd-481f-b15a-e383704db414 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.228632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbffb07d-41cd-481f-b15a-e383704db414 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.680732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:42.681967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:42.696812 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.697673 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.709950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.710421 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.730120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] HTTP exception thrown: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.731169 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-dbffb07d-41cd-481f-b15a-e383704db414 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Request method failure captured: Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 HTTP/1.1 Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y9Fr72RZtk4aHgvJFmUrITSuRa_dCKAFC4W2NCshF8YcYC-ix28NzJ2By4tM8XBJapdor4zi8nzoL3fWCPkwY0nQpwlra9x94KYgFk7Gbe7TKGzOYL6V9GaIXm67zzSDO8_VXI42poei6wEluo_6F4Wy20jYRqpWxVESmdebcD3YGo Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: b61afdae54fc4f76b7dd31798c4226f4 Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:51:42.735280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b61afdae54fc4f76b7dd31798c4226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b61afdae54fc4f76b7dd31798c4226f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b61afdae54fc4f76b7dd31798c4226f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b61afdae54fc4f76b7dd31798c4226f4"}]}] Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: b61afdae54fc4f76b7dd31798c4226f4 Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-DeleteServersTestJSON-896546155-project Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: baaf254c2b28444bab7f1c7cc3fbc42c Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-DeleteServersTestJSON-896546155-project Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.743911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '6d3a0d59-9562-45d0-befc-fc63474db543'} Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:42.744744 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.745983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.747054 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Returning 404 to user: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:42.747054 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2870d2f4-5c40-4fda-943e-2f33b691da82 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 404 len: 111 microversion: 2.1 time: 0.060826 Jul 18 16:51:42.747054 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 108/206] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:51:42 2022] DELETE /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:51:42.747054 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:42.747322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] [instance: 6d3a0d59-9562-45d0-befc-fc63474db543] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:42.755013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.755660 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.756704 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.757320 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.758524 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-dbffb07d-41cd-481f-b15a-e383704db414 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.565649 Jul 18 16:51:42.766423 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 99/207] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:42 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:42.786227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] HTTP exception thrown: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Request method failure captured: Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 HTTP/1.1 Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y9Fr72RZtk4aHgvJFmUrITSuRa_dCKAFC4W2NCshF8YcYC-ix28NzJ2By4tM8XBJapdor4zi8nzoL3fWCPkwY0nQpwlra9x94KYgFk7Gbe7TKGzOYL6V9GaIXm67zzSDO8_VXI42poei6wEluo_6F4Wy20jYRqpWxVESmdebcD3YGo Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: b61afdae54fc4f76b7dd31798c4226f4 Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:51:42.787425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b61afdae54fc4f76b7dd31798c4226f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b61afdae54fc4f76b7dd31798c4226f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b61afdae54fc4f76b7dd31798c4226f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b61afdae54fc4f76b7dd31798c4226f4"}]}] Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: b61afdae54fc4f76b7dd31798c4226f4 Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-DeleteServersTestJSON-896546155 Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-DeleteServersTestJSON-896546155-project Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: baaf254c2b28444bab7f1c7cc3fbc42c Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-DeleteServersTestJSON-896546155-project Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.788601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '6d3a0d59-9562-45d0-befc-fc63474db543'} Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:51:42.789322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. Jul 18 16:51:42.790974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:51:42.799821 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] Returning 404 to user: Instance 6d3a0d59-9562-45d0-befc-fc63474db543 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:51:42.799821 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4cfdc2c1-c385-47ca-ac41-eb6cda38e6b6 tempest-DeleteServersTestJSON-896546155 tempest-DeleteServersTestJSON-896546155-project] 10.222.0.88 "GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543" status: 404 len: 111 microversion: 2.1 time: 0.053328 Jul 18 16:51:42.801099 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 109/208] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:42 2022] GET /compute/v2.1/servers/6d3a0d59-9562-45d0-befc-fc63474db543 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:43.775868 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-00c140f4-e900-4523-87a4-fe8e8613f818 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:43.776478 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-00c140f4-e900-4523-87a4-fe8e8613f818 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:43.786862 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00c140f4-e900-4523-87a4-fe8e8613f818 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.787442 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00c140f4-e900-4523-87a4-fe8e8613f818 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:43.788368 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00c140f4-e900-4523-87a4-fe8e8613f818 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.788961 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00c140f4-e900-4523-87a4-fe8e8613f818 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:44.313015 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-00c140f4-e900-4523-87a4-fe8e8613f818 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:44.321913 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-00c140f4-e900-4523-87a4-fe8e8613f818 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.550153 Jul 18 16:51:44.324479 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 100/209] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:43 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:45.048313 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1154714908", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:45.146587 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] validate_networks() for None {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:51:45.344937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8e64689e-2337-48a8-85a6-a9a6956862bb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:45.345555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8e64689e-2337-48a8-85a6-a9a6956862bb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:45.366418 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8e64689e-2337-48a8-85a6-a9a6956862bb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:45.373314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8e64689e-2337-48a8-85a6-a9a6956862bb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.378151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8e64689e-2337-48a8-85a6-a9a6956862bb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:45.378627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8e64689e-2337-48a8-85a6-a9a6956862bb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.817137 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8e64689e-2337-48a8-85a6-a9a6956862bb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:45.829196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8e64689e-2337-48a8-85a6-a9a6956862bb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.490897 Jul 18 16:51:45.830430 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 101/210] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:45 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:46.278591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:51:46.278996 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:51:46.279767 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:51:46.280366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:51:46.280824 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:51:46.319412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.319901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.325847 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.326320 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.374438 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Getting quotas for project b4ac8a7f26f6423fb63683053905a4fe. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:46.391774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Getting quotas for user cb40c15365c14eb6ae597be773bafc3a and project b4ac8a7f26f6423fb63683053905a4fe. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:46.429277 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:51:46.439797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:51:46.853160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-05602728-a92c-49ce-b471-5e1781a657e0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:46.854453 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-05602728-a92c-49ce-b471-5e1781a657e0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:46.874532 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05602728-a92c-49ce-b471-5e1781a657e0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.874982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05602728-a92c-49ce-b471-5e1781a657e0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.875782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05602728-a92c-49ce-b471-5e1781a657e0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.876300 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05602728-a92c-49ce-b471-5e1781a657e0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.984011 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1439f913-820f-4476-8330-f9863a5f1c63 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.937819 Jul 18 16:51:46.991652 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 110/211] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:51:47.013576 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-84782ce4-56ea-4d00-8b69-35efc3559d03 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:47.018858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-84782ce4-56ea-4d00-8b69-35efc3559d03 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:47.185796 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-05602728-a92c-49ce-b471-5e1781a657e0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.195151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-05602728-a92c-49ce-b471-5e1781a657e0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.351146 Jul 18 16:51:47.195743 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 102/212] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:46 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:47.446262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-84782ce4-56ea-4d00-8b69-35efc3559d03 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.474687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-84782ce4-56ea-4d00-8b69-35efc3559d03 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1215 microversion: 2.1 time: 0.471741 Jul 18 16:51:47.478655 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 111/213] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:46 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1215 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:48.214279 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-eac1f0b3-ca2f-497d-8004-8765d9a380b7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:48.215548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-eac1f0b3-ca2f-497d-8004-8765d9a380b7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:48.231158 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eac1f0b3-ca2f-497d-8004-8765d9a380b7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.240312 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eac1f0b3-ca2f-497d-8004-8765d9a380b7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.244035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eac1f0b3-ca2f-497d-8004-8765d9a380b7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.259842 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eac1f0b3-ca2f-497d-8004-8765d9a380b7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.497280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e852a362-0760-4c90-9551-8ceed9a5b3de tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:48.497280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e852a362-0760-4c90-9551-8ceed9a5b3de tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:48.511315 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e852a362-0760-4c90-9551-8ceed9a5b3de tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.511774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e852a362-0760-4c90-9551-8ceed9a5b3de tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.512562 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e852a362-0760-4c90-9551-8ceed9a5b3de tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.513033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e852a362-0760-4c90-9551-8ceed9a5b3de tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.571689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-eac1f0b3-ca2f-497d-8004-8765d9a380b7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:48.583552 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-eac1f0b3-ca2f-497d-8004-8765d9a380b7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.374222 Jul 18 16:51:48.597638 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 103/214] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:48 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:48.656212 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e852a362-0760-4c90-9551-8ceed9a5b3de tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:48.666216 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e852a362-0760-4c90-9551-8ceed9a5b3de tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1219 microversion: 2.1 time: 0.174052 Jul 18 16:51:48.669696 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 112/215] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:48 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:49.604761 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ff697410-a97a-42c8-a9ee-08c0e1662594 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:49.606513 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ff697410-a97a-42c8-a9ee-08c0e1662594 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:49.633925 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff697410-a97a-42c8-a9ee-08c0e1662594 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.636854 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff697410-a97a-42c8-a9ee-08c0e1662594 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.639717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff697410-a97a-42c8-a9ee-08c0e1662594 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.640425 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff697410-a97a-42c8-a9ee-08c0e1662594 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.688506 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-75ffe20b-6070-4611-8aca-7f207c2621ea tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:49.695675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-75ffe20b-6070-4611-8aca-7f207c2621ea tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:49.698888 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-75ffe20b-6070-4611-8aca-7f207c2621ea tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.702340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-75ffe20b-6070-4611-8aca-7f207c2621ea tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.704655 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-75ffe20b-6070-4611-8aca-7f207c2621ea tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.705160 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-75ffe20b-6070-4611-8aca-7f207c2621ea tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.864055 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-75ffe20b-6070-4611-8aca-7f207c2621ea tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:49.873268 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-75ffe20b-6070-4611-8aca-7f207c2621ea tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1211 microversion: 2.1 time: 0.191077 Jul 18 16:51:49.874041 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 113/216] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:49 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1211 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:49.883897 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ff697410-a97a-42c8-a9ee-08c0e1662594 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:49.883897 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:49.886093 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ff697410-a97a-42c8-a9ee-08c0e1662594 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.287634 Jul 18 16:51:49.895963 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 104/217] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:49 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:50.773404 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-72afe6ae-2ddf-4b2a-b164-bab8c7bbe7f4 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Action: 'create', calling method: .version_select at 0x7fd4f7272af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1419738871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUj4aNknaf1eEBjyQ+RTIUUBGrmkcXwSNLsyaCgzHMoYN7Mn30yDP9NcnfL3a/rmmbPuuJyPOWkSjZ/D6fIp2BO12TfYoCnA4Ua7wwLs/ALP/Wt8usFfyopJegkjJk/dw=="}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:50.793493 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-72afe6ae-2ddf-4b2a-b164-bab8c7bbe7f4 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Getting quotas for project e3e2c4fb7f354179a90bfa7d963aa50c. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:51:50.798478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-72afe6ae-2ddf-4b2a-b164-bab8c7bbe7f4 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Getting quotas for user 8016e561397f4b4faca9e03343d51355 and project e3e2c4fb7f354179a90bfa7d963aa50c. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:51:50.895656 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9d456ab3-d094-4a11-b4bc-0f7ec61e9539 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:50.895656 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9d456ab3-d094-4a11-b4bc-0f7ec61e9539 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:50.899247 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9d456ab3-d094-4a11-b4bc-0f7ec61e9539 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.899688 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9d456ab3-d094-4a11-b4bc-0f7ec61e9539 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.900636 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9d456ab3-d094-4a11-b4bc-0f7ec61e9539 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.901245 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9d456ab3-d094-4a11-b4bc-0f7ec61e9539 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.907789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-72afe6ae-2ddf-4b2a-b164-bab8c7bbe7f4 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.459929 Jul 18 16:51:50.908418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 114/218] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:51:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:50.919723 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d2bce160-a7e2-4908-9cbe-42e7969270fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:50.920344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d2bce160-a7e2-4908-9cbe-42e7969270fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:50.947254 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d2bce160-a7e2-4908-9cbe-42e7969270fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.947949 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d2bce160-a7e2-4908-9cbe-42e7969270fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.949134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d2bce160-a7e2-4908-9cbe-42e7969270fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:50.949781 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d2bce160-a7e2-4908-9cbe-42e7969270fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.003345 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9d456ab3-d094-4a11-b4bc-0f7ec61e9539 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:51.014529 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9d456ab3-d094-4a11-b4bc-0f7ec61e9539 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1211 microversion: 2.1 time: 0.126908 Jul 18 16:51:51.015445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 105/219] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:50 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:51.169973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d2bce160-a7e2-4908-9cbe-42e7969270fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:51.184994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d2bce160-a7e2-4908-9cbe-42e7969270fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.269053 Jul 18 16:51:51.187528 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 115/220] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:50 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:52.032748 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5edb67c4-2232-493c-9a4c-d41363311b49 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:52.033408 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5edb67c4-2232-493c-9a4c-d41363311b49 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:52.041628 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5edb67c4-2232-493c-9a4c-d41363311b49 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.042081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5edb67c4-2232-493c-9a4c-d41363311b49 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.043082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5edb67c4-2232-493c-9a4c-d41363311b49 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.043520 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5edb67c4-2232-493c-9a4c-d41363311b49 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.179058 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5edb67c4-2232-493c-9a4c-d41363311b49 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:52.209603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-05ba7031-77cf-45c2-90b1-dc2702bc7398 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:52.218132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5edb67c4-2232-493c-9a4c-d41363311b49 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1211 microversion: 2.1 time: 0.188114 Jul 18 16:51:52.219624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-05ba7031-77cf-45c2-90b1-dc2702bc7398 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:52.242726 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 106/221] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:52 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1211 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:52.258242 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-05ba7031-77cf-45c2-90b1-dc2702bc7398 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.267129 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-05ba7031-77cf-45c2-90b1-dc2702bc7398 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.273243 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-05ba7031-77cf-45c2-90b1-dc2702bc7398 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.278948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-05ba7031-77cf-45c2-90b1-dc2702bc7398 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.592489 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-05ba7031-77cf-45c2-90b1-dc2702bc7398 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:52.603499 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-05ba7031-77cf-45c2-90b1-dc2702bc7398 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.404749 Jul 18 16:51:52.612915 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 116/222] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:52 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:53.249581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-071736e3-893e-4433-8fee-a7c358b5d228 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:53.251111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-071736e3-893e-4433-8fee-a7c358b5d228 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:53.260410 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-071736e3-893e-4433-8fee-a7c358b5d228 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.261189 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-071736e3-893e-4433-8fee-a7c358b5d228 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.266565 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-071736e3-893e-4433-8fee-a7c358b5d228 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.266565 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-071736e3-893e-4433-8fee-a7c358b5d228 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.620570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7f1aa56d-ce02-4369-b3fc-5dba85028a1d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:53.624552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7f1aa56d-ce02-4369-b3fc-5dba85028a1d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:53.633742 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7f1aa56d-ce02-4369-b3fc-5dba85028a1d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.635055 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7f1aa56d-ce02-4369-b3fc-5dba85028a1d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.644431 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7f1aa56d-ce02-4369-b3fc-5dba85028a1d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.647187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7f1aa56d-ce02-4369-b3fc-5dba85028a1d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.765082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-071736e3-893e-4433-8fee-a7c358b5d228 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:53.773360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-071736e3-893e-4433-8fee-a7c358b5d228 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1267 microversion: 2.1 time: 0.528941 Jul 18 16:51:53.776603 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 107/223] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:53 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1267 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:54.031763 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7f1aa56d-ce02-4369-b3fc-5dba85028a1d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.041948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7f1aa56d-ce02-4369-b3fc-5dba85028a1d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1522 microversion: 2.1 time: 0.426269 Jul 18 16:51:54.042529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 117/224] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:53 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:54.792611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bf4a8db5-1fa6-4317-8ab9-97a73a523fab tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:54.793974 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-bf4a8db5-1fa6-4317-8ab9-97a73a523fab tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:54.805097 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bf4a8db5-1fa6-4317-8ab9-97a73a523fab tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.805756 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bf4a8db5-1fa6-4317-8ab9-97a73a523fab tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.806784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bf4a8db5-1fa6-4317-8ab9-97a73a523fab tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.807215 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bf4a8db5-1fa6-4317-8ab9-97a73a523fab tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.888082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-bf4a8db5-1fa6-4317-8ab9-97a73a523fab tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.897357 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-bf4a8db5-1fa6-4317-8ab9-97a73a523fab tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1273 microversion: 2.1 time: 0.109087 Jul 18 16:51:54.898003 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 108/225] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:54 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:55.059171 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b6eb077b-ab18-4816-b25a-7b539094e7d3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:55.059804 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b6eb077b-ab18-4816-b25a-7b539094e7d3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:55.066516 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b6eb077b-ab18-4816-b25a-7b539094e7d3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.066972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b6eb077b-ab18-4816-b25a-7b539094e7d3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.067739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b6eb077b-ab18-4816-b25a-7b539094e7d3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.068168 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b6eb077b-ab18-4816-b25a-7b539094e7d3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.237126 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b6eb077b-ab18-4816-b25a-7b539094e7d3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:55.248547 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b6eb077b-ab18-4816-b25a-7b539094e7d3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1502 microversion: 2.1 time: 0.193169 Jul 18 16:51:55.249717 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 118/226] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:55 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:55.266619 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b81b8d48-39f0-4406-b46b-e2877bdfdf94 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:55.268477 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b81b8d48-39f0-4406-b46b-e2877bdfdf94 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:55.277467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b81b8d48-39f0-4406-b46b-e2877bdfdf94 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.278270 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b81b8d48-39f0-4406-b46b-e2877bdfdf94 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.279389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b81b8d48-39f0-4406-b46b-e2877bdfdf94 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.280758 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b81b8d48-39f0-4406-b46b-e2877bdfdf94 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.512978 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b81b8d48-39f0-4406-b46b-e2877bdfdf94 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:55.535106 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b81b8d48-39f0-4406-b46b-e2877bdfdf94 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1516 microversion: 2.1 time: 0.273559 Jul 18 16:51:55.542453 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 109/227] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:55 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:55.929619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8757f44c-f068-4248-8ed8-28208d7c6a52 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:55.930596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8757f44c-f068-4248-8ed8-28208d7c6a52 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:55.944704 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8757f44c-f068-4248-8ed8-28208d7c6a52 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.945597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8757f44c-f068-4248-8ed8-28208d7c6a52 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.945939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8757f44c-f068-4248-8ed8-28208d7c6a52 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.946566 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8757f44c-f068-4248-8ed8-28208d7c6a52 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:56.176237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8757f44c-f068-4248-8ed8-28208d7c6a52 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:56.205912 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8757f44c-f068-4248-8ed8-28208d7c6a52 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.276190 Jul 18 16:51:56.205912 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 119/228] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:55 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:57.219702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c6b3a315-82ad-4926-beca-50e6b333df7a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:57.220295 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c6b3a315-82ad-4926-beca-50e6b333df7a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:57.227059 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c6b3a315-82ad-4926-beca-50e6b333df7a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.227510 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c6b3a315-82ad-4926-beca-50e6b333df7a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.228287 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c6b3a315-82ad-4926-beca-50e6b333df7a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.228733 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c6b3a315-82ad-4926-beca-50e6b333df7a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.248585 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-56328033-3e2b-453c-bb07-377c833a26ec req-6db4e906-efb9-48ae-afdd-a3c556ab2171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd22712-96fb-4fad-a26f-0ce58aec26ba", "tag": "0b8fb609-49a9-4aa7-a782-59523d1052fc"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:57.258200 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:57.262314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-56328033-3e2b-453c-bb07-377c833a26ec req-6db4e906-efb9-48ae-afdd-a3c556ab2171 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.269341 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-56328033-3e2b-453c-bb07-377c833a26ec req-6db4e906-efb9-48ae-afdd-a3c556ab2171 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.287375 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-56328033-3e2b-453c-bb07-377c833a26ec req-6db4e906-efb9-48ae-afdd-a3c556ab2171 service nova] Creating event network-changed:0b8fb609-49a9-4aa7-a782-59523d1052fc for instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba on hv-cinder-84617 Jul 18 16:51:57.296134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-56328033-3e2b-453c-bb07-377c833a26ec req-6db4e906-efb9-48ae-afdd-a3c556ab2171 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052672 Jul 18 16:51:57.297660 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 120/229] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:51:57.397332 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c6b3a315-82ad-4926-beca-50e6b333df7a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:57.406179 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c6b3a315-82ad-4926-beca-50e6b333df7a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.190166 Jul 18 16:51:57.406785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 110/230] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:57 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:57.965500 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-fdbc6005-817b-43d5-a3ed-68d82a1991a0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:57.966598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-fdbc6005-817b-43d5-a3ed-68d82a1991a0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:57.974974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdbc6005-817b-43d5-a3ed-68d82a1991a0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.975426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdbc6005-817b-43d5-a3ed-68d82a1991a0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.976203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdbc6005-817b-43d5-a3ed-68d82a1991a0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.976656 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdbc6005-817b-43d5-a3ed-68d82a1991a0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.022912 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-fdbc6005-817b-43d5-a3ed-68d82a1991a0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'flavor' on Instance uuid 9b0acf48-1262-4cbc-98dc-562510f2cc10 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:51:58.358119 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-fdbc6005-817b-43d5-a3ed-68d82a1991a0 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10/action" status: 200 len: 32 microversion: 2.1 time: 0.398885 Jul 18 16:51:58.359525 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 121/231] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:51:57 2022] POST /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10/action => generated 32 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:51:58.376448 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-14bbf29b-3f06-4eb7-97bb-7fd1e0d873ee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:58.378595 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-14bbf29b-3f06-4eb7-97bb-7fd1e0d873ee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:58.387205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-14bbf29b-3f06-4eb7-97bb-7fd1e0d873ee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.387650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-14bbf29b-3f06-4eb7-97bb-7fd1e0d873ee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.388420 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-14bbf29b-3f06-4eb7-97bb-7fd1e0d873ee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.388989 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-14bbf29b-3f06-4eb7-97bb-7fd1e0d873ee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.428430 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2a2ae040-c709-49a4-8a0b-483a72efc635 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:58.429217 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2a2ae040-c709-49a4-8a0b-483a72efc635 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:58.437579 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a2ae040-c709-49a4-8a0b-483a72efc635 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.438346 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a2ae040-c709-49a4-8a0b-483a72efc635 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.439227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a2ae040-c709-49a4-8a0b-483a72efc635 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.440446 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a2ae040-c709-49a4-8a0b-483a72efc635 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.642979 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2a2ae040-c709-49a4-8a0b-483a72efc635 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.652946 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:58.655634 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2a2ae040-c709-49a4-8a0b-483a72efc635 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.234027 Jul 18 16:51:58.656552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 122/232] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:58 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:58.919151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-14bbf29b-3f06-4eb7-97bb-7fd1e0d873ee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.933484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-14bbf29b-3f06-4eb7-97bb-7fd1e0d873ee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.560943 Jul 18 16:51:58.935815 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 111/233] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:58 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:59.672967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a1eb8991-fed1-409e-8fb7-c77663975671 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:59.673564 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a1eb8991-fed1-409e-8fb7-c77663975671 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:59.679919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a1eb8991-fed1-409e-8fb7-c77663975671 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.680361 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a1eb8991-fed1-409e-8fb7-c77663975671 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.681261 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a1eb8991-fed1-409e-8fb7-c77663975671 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.681695 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a1eb8991-fed1-409e-8fb7-c77663975671 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.840449 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a1eb8991-fed1-409e-8fb7-c77663975671 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:59.848238 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a1eb8991-fed1-409e-8fb7-c77663975671 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.179667 Jul 18 16:51:59.848830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 123/234] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:59 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:59.950953 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ef2254eb-a375-40eb-930c-3ac863ef137e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:59.951560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ef2254eb-a375-40eb-930c-3ac863ef137e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:59.959688 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ef2254eb-a375-40eb-930c-3ac863ef137e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.963906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ef2254eb-a375-40eb-930c-3ac863ef137e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.963906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ef2254eb-a375-40eb-930c-3ac863ef137e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.963906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ef2254eb-a375-40eb-930c-3ac863ef137e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.125631 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ef2254eb-a375-40eb-930c-3ac863ef137e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:00.134075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ef2254eb-a375-40eb-930c-3ac863ef137e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.186958 Jul 18 16:52:00.134970 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 112/235] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:59 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:00.869146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b3a06f55-6513-44b4-a556-a673fa33ce40 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:00.869990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b3a06f55-6513-44b4-a556-a673fa33ce40 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:00.873292 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=12 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:00.879342 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b3a06f55-6513-44b4-a556-a673fa33ce40 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.879902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b3a06f55-6513-44b4-a556-a673fa33ce40 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.880798 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b3a06f55-6513-44b4-a556-a673fa33ce40 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.882892 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b3a06f55-6513-44b4-a556-a673fa33ce40 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.050436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b3a06f55-6513-44b4-a556-a673fa33ce40 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:01.061280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b3a06f55-6513-44b4-a556-a673fa33ce40 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.197975 Jul 18 16:52:01.062095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 124/236] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:00 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:01.154408 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e3159826-7274-43aa-9fbf-4879264c7937 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:01.155120 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e3159826-7274-43aa-9fbf-4879264c7937 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:01.161989 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e3159826-7274-43aa-9fbf-4879264c7937 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.162430 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e3159826-7274-43aa-9fbf-4879264c7937 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.163193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e3159826-7274-43aa-9fbf-4879264c7937 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.163621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e3159826-7274-43aa-9fbf-4879264c7937 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.310106 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e3159826-7274-43aa-9fbf-4879264c7937 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:01.313821 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e3159826-7274-43aa-9fbf-4879264c7937 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.163054 Jul 18 16:52:01.314986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 113/237] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:01 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:02.082000 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d83ce247-6934-4c6e-864b-852d15e52471 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:02.083966 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d83ce247-6934-4c6e-864b-852d15e52471 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:02.090810 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d83ce247-6934-4c6e-864b-852d15e52471 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:02.091511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d83ce247-6934-4c6e-864b-852d15e52471 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.092661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d83ce247-6934-4c6e-864b-852d15e52471 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:02.093935 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d83ce247-6934-4c6e-864b-852d15e52471 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.235065 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d83ce247-6934-4c6e-864b-852d15e52471 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.242607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d83ce247-6934-4c6e-864b-852d15e52471 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.164343 Jul 18 16:52:02.245050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 125/238] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:02 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:02.332598 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8a4a8ec5-3b42-4024-b6ad-982e0c2a958a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:02.333245 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8a4a8ec5-3b42-4024-b6ad-982e0c2a958a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:02.340258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8a4a8ec5-3b42-4024-b6ad-982e0c2a958a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:02.340706 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8a4a8ec5-3b42-4024-b6ad-982e0c2a958a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.341507 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8a4a8ec5-3b42-4024-b6ad-982e0c2a958a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:02.341943 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8a4a8ec5-3b42-4024-b6ad-982e0c2a958a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.499500 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8a4a8ec5-3b42-4024-b6ad-982e0c2a958a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.507623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8a4a8ec5-3b42-4024-b6ad-982e0c2a958a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.180162 Jul 18 16:52:02.508446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 114/239] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:02 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:03.259494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-22588425-af85-46d4-a203-6b46bc57b2f8 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:03.269478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-22588425-af85-46d4-a203-6b46bc57b2f8 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:03.280535 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-22588425-af85-46d4-a203-6b46bc57b2f8 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.281624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-22588425-af85-46d4-a203-6b46bc57b2f8 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.282685 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-22588425-af85-46d4-a203-6b46bc57b2f8 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.283322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-22588425-af85-46d4-a203-6b46bc57b2f8 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.426184 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-22588425-af85-46d4-a203-6b46bc57b2f8 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:03.434033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-22588425-af85-46d4-a203-6b46bc57b2f8 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.178665 Jul 18 16:52:03.434612 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 126/240] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:03 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:03.524094 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4a69f037-0c5d-48e8-922c-b312bc324715 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:03.524682 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4a69f037-0c5d-48e8-922c-b312bc324715 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:03.531204 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4a69f037-0c5d-48e8-922c-b312bc324715 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.531650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4a69f037-0c5d-48e8-922c-b312bc324715 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.532416 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4a69f037-0c5d-48e8-922c-b312bc324715 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.532849 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4a69f037-0c5d-48e8-922c-b312bc324715 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.668601 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4a69f037-0c5d-48e8-922c-b312bc324715 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:03.676788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4a69f037-0c5d-48e8-922c-b312bc324715 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.156657 Jul 18 16:52:03.677387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 115/241] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:03 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:04.452167 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c00adaae-97a3-4cfa-bcf8-b644b11ffddb tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:04.453346 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c00adaae-97a3-4cfa-bcf8-b644b11ffddb tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:04.460428 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c00adaae-97a3-4cfa-bcf8-b644b11ffddb tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.460899 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c00adaae-97a3-4cfa-bcf8-b644b11ffddb tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.461674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c00adaae-97a3-4cfa-bcf8-b644b11ffddb tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.462105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c00adaae-97a3-4cfa-bcf8-b644b11ffddb tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.630591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c00adaae-97a3-4cfa-bcf8-b644b11ffddb tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:04.639136 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c00adaae-97a3-4cfa-bcf8-b644b11ffddb tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.191819 Jul 18 16:52:04.640039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 127/242] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:04 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:04.694587 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a078a8cc-920b-4bcf-b1ab-16515299cbaf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:04.696029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a078a8cc-920b-4bcf-b1ab-16515299cbaf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:04.710052 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a078a8cc-920b-4bcf-b1ab-16515299cbaf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.719428 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a078a8cc-920b-4bcf-b1ab-16515299cbaf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.720947 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a078a8cc-920b-4bcf-b1ab-16515299cbaf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.721608 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a078a8cc-920b-4bcf-b1ab-16515299cbaf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.930646 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a078a8cc-920b-4bcf-b1ab-16515299cbaf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:04.940010 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a078a8cc-920b-4bcf-b1ab-16515299cbaf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.248643 Jul 18 16:52:04.940687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 116/243] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:04 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:05.657732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5b4c7ff8-b530-43ed-ae74-c06a7d5f3887 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:05.659374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5b4c7ff8-b530-43ed-ae74-c06a7d5f3887 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:05.669599 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b4c7ff8-b530-43ed-ae74-c06a7d5f3887 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.670862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b4c7ff8-b530-43ed-ae74-c06a7d5f3887 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.671654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b4c7ff8-b530-43ed-ae74-c06a7d5f3887 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.672102 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b4c7ff8-b530-43ed-ae74-c06a7d5f3887 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.857317 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5b4c7ff8-b530-43ed-ae74-c06a7d5f3887 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:05.883247 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5b4c7ff8-b530-43ed-ae74-c06a7d5f3887 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.229081 Jul 18 16:52:05.894001 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 128/244] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:05 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:05.924252 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-1eda6201-1a4f-4596-ae94-08dffaaec437 req-55a42c9f-ed38-4777-bd77-190a1dc87716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd22712-96fb-4fad-a26f-0ce58aec26ba", "name": "network-vif-plugged", "status": "completed", "tag": "0b8fb609-49a9-4aa7-a782-59523d1052fc"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:05.938409 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-1eda6201-1a4f-4596-ae94-08dffaaec437 req-55a42c9f-ed38-4777-bd77-190a1dc87716 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.939611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-1eda6201-1a4f-4596-ae94-08dffaaec437 req-55a42c9f-ed38-4777-bd77-190a1dc87716 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.967080 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cec8a8a0-5782-4596-bf0b-9830fa0bf01f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:05.967895 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cec8a8a0-5782-4596-bf0b-9830fa0bf01f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:05.970289 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-1eda6201-1a4f-4596-ae94-08dffaaec437 req-55a42c9f-ed38-4777-bd77-190a1dc87716 service nova] Creating event network-vif-plugged:0b8fb609-49a9-4aa7-a782-59523d1052fc for instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba on hv-cinder-84617 Jul 18 16:52:05.977358 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-1eda6201-1a4f-4596-ae94-08dffaaec437 req-55a42c9f-ed38-4777-bd77-190a1dc87716 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057434 Jul 18 16:52:05.978507 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 117/245] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:05.979275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cec8a8a0-5782-4596-bf0b-9830fa0bf01f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.979791 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cec8a8a0-5782-4596-bf0b-9830fa0bf01f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.980691 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cec8a8a0-5782-4596-bf0b-9830fa0bf01f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.981156 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cec8a8a0-5782-4596-bf0b-9830fa0bf01f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.237190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-cec8a8a0-5782-4596-bf0b-9830fa0bf01f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:06.249454 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cec8a8a0-5782-4596-bf0b-9830fa0bf01f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.292130 Jul 18 16:52:06.250307 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 129/246] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:05 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:06.904341 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b1278aa4-fb04-4688-a1b4-4d378c0419ff tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:06.905084 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b1278aa4-fb04-4688-a1b4-4d378c0419ff tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:06.913512 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b1278aa4-fb04-4688-a1b4-4d378c0419ff tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.913966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b1278aa4-fb04-4688-a1b4-4d378c0419ff tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.914741 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b1278aa4-fb04-4688-a1b4-4d378c0419ff tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.915182 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b1278aa4-fb04-4688-a1b4-4d378c0419ff tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.269618 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-131d59e7-4ea5-4edf-8e4f-a8491de8cf04 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:07.270233 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-131d59e7-4ea5-4edf-8e4f-a8491de8cf04 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:07.287808 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-131d59e7-4ea5-4edf-8e4f-a8491de8cf04 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:07.292116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-131d59e7-4ea5-4edf-8e4f-a8491de8cf04 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.293396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-131d59e7-4ea5-4edf-8e4f-a8491de8cf04 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:07.297279 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-131d59e7-4ea5-4edf-8e4f-a8491de8cf04 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.460810 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b1278aa4-fb04-4688-a1b4-4d378c0419ff tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:07.472417 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b1278aa4-fb04-4688-a1b4-4d378c0419ff tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.574198 Jul 18 16:52:07.473370 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 118/247] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:06 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:07.509569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-131d59e7-4ea5-4edf-8e4f-a8491de8cf04 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:07.519628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-131d59e7-4ea5-4edf-8e4f-a8491de8cf04 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.255038 Jul 18 16:52:07.520739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 130/248] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:07 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:08.502402 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-417d0daf-c048-4459-8b1f-ff3420163246 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:08.503181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-417d0daf-c048-4459-8b1f-ff3420163246 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:08.510921 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-417d0daf-c048-4459-8b1f-ff3420163246 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.511615 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-417d0daf-c048-4459-8b1f-ff3420163246 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.512585 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-417d0daf-c048-4459-8b1f-ff3420163246 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.512840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-417d0daf-c048-4459-8b1f-ff3420163246 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.538065 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-48126f71-608c-4002-aeb4-f27a5a80eeec tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:08.538914 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-48126f71-608c-4002-aeb4-f27a5a80eeec tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:08.545209 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-48126f71-608c-4002-aeb4-f27a5a80eeec tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.545672 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-48126f71-608c-4002-aeb4-f27a5a80eeec tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.546487 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-48126f71-608c-4002-aeb4-f27a5a80eeec tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:08.546941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-48126f71-608c-4002-aeb4-f27a5a80eeec tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.684416 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-417d0daf-c048-4459-8b1f-ff3420163246 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:08.702576 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-417d0daf-c048-4459-8b1f-ff3420163246 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1315 microversion: 2.1 time: 0.204706 Jul 18 16:52:08.703527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 119/249] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:08 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:08.746855 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-48126f71-608c-4002-aeb4-f27a5a80eeec tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:08.756242 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-48126f71-608c-4002-aeb4-f27a5a80eeec tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.222158 Jul 18 16:52:08.756704 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 131/250] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:08 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:09.726732 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f641a8e8-9fa9-4d91-b9da-ea06c3d32620 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:09.727341 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f641a8e8-9fa9-4d91-b9da-ea06c3d32620 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:09.733784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f641a8e8-9fa9-4d91-b9da-ea06c3d32620 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.734232 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f641a8e8-9fa9-4d91-b9da-ea06c3d32620 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.736716 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f641a8e8-9fa9-4d91-b9da-ea06c3d32620 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.736716 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f641a8e8-9fa9-4d91-b9da-ea06c3d32620 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.773939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8285f848-b4a2-4103-bb31-d99a26771520 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:09.775325 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8285f848-b4a2-4103-bb31-d99a26771520 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:09.777548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:09.782471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8285f848-b4a2-4103-bb31-d99a26771520 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.783609 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8285f848-b4a2-4103-bb31-d99a26771520 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.784583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8285f848-b4a2-4103-bb31-d99a26771520 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.785254 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8285f848-b4a2-4103-bb31-d99a26771520 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.882384 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f641a8e8-9fa9-4d91-b9da-ea06c3d32620 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:09.887545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f641a8e8-9fa9-4d91-b9da-ea06c3d32620 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1465 microversion: 2.1 time: 0.164525 Jul 18 16:52:09.888130 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 120/251] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:09 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:09.926604 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8285f848-b4a2-4103-bb31-d99a26771520 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:09.934689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8285f848-b4a2-4103-bb31-d99a26771520 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.164515 Jul 18 16:52:09.935856 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 132/252] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:09 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:09.986758 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3141005e-07f2-4887-8036-78015550af9d tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:09.987260 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3141005e-07f2-4887-8036-78015550af9d tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:09.995038 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3141005e-07f2-4887-8036-78015550af9d tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.995038 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3141005e-07f2-4887-8036-78015550af9d tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.995038 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3141005e-07f2-4887-8036-78015550af9d tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.996021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3141005e-07f2-4887-8036-78015550af9d tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.025742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3141005e-07f2-4887-8036-78015550af9d tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:52:10.041780 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=100 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:10.351559 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3141005e-07f2-4887-8036-78015550af9d tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 204 len: 0 microversion: 2.1 time: 0.368378 Jul 18 16:52:10.352163 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 121/253] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:52:09 2022] DELETE /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:52:10.360512 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d414fd13-9978-4cbd-be6a-636e36e41fbc tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:10.361153 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d414fd13-9978-4cbd-be6a-636e36e41fbc tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:10.369943 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d414fd13-9978-4cbd-be6a-636e36e41fbc tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.370386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d414fd13-9978-4cbd-be6a-636e36e41fbc tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.371184 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d414fd13-9978-4cbd-be6a-636e36e41fbc tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.371657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d414fd13-9978-4cbd-be6a-636e36e41fbc tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.519492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d414fd13-9978-4cbd-be6a-636e36e41fbc tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:10.527282 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d414fd13-9978-4cbd-be6a-636e36e41fbc tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1471 microversion: 2.1 time: 0.170550 Jul 18 16:52:10.527884 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 133/254] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:10 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:10.952404 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a71441a5-22ed-454c-b622-e843fb8c671c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:10.953181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a71441a5-22ed-454c-b622-e843fb8c671c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:10.961140 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a71441a5-22ed-454c-b622-e843fb8c671c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.961594 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a71441a5-22ed-454c-b622-e843fb8c671c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.962378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a71441a5-22ed-454c-b622-e843fb8c671c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.962812 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a71441a5-22ed-454c-b622-e843fb8c671c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.109689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a71441a5-22ed-454c-b622-e843fb8c671c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:11.123616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a71441a5-22ed-454c-b622-e843fb8c671c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.175283 Jul 18 16:52:11.124588 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 122/255] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:10 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:11.544662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-36061cf6-b873-48b6-8d0b-d4b51eeac84a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:11.545474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-36061cf6-b873-48b6-8d0b-d4b51eeac84a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:11.553061 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-36061cf6-b873-48b6-8d0b-d4b51eeac84a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.553741 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-36061cf6-b873-48b6-8d0b-d4b51eeac84a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.555145 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-36061cf6-b873-48b6-8d0b-d4b51eeac84a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.555348 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-36061cf6-b873-48b6-8d0b-d4b51eeac84a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.688456 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b7cf10b3-d7f1-482a-bd11-019d77c9c284 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:11.688719 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b7cf10b3-d7f1-482a-bd11-019d77c9c284 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:11.690965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-36061cf6-b873-48b6-8d0b-d4b51eeac84a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:11.694848 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b7cf10b3-d7f1-482a-bd11-019d77c9c284 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.695296 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b7cf10b3-d7f1-482a-bd11-019d77c9c284 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.696074 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b7cf10b3-d7f1-482a-bd11-019d77c9c284 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.696503 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b7cf10b3-d7f1-482a-bd11-019d77c9c284 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.698381 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-36061cf6-b873-48b6-8d0b-d4b51eeac84a tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1471 microversion: 2.1 time: 0.157732 Jul 18 16:52:11.698964 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 134/256] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:11 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:11.722281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b7cf10b3-d7f1-482a-bd11-019d77c9c284 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/ips" status: 200 len: 145 microversion: 2.1 time: 0.037808 Jul 18 16:52:11.722861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 123/257] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 16:52:11 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:52:12.147145 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6c5c95a3-5e81-49f6-8149-afdea5e03ddc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:12.147596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6c5c95a3-5e81-49f6-8149-afdea5e03ddc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:12.160237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6c5c95a3-5e81-49f6-8149-afdea5e03ddc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.172296 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6c5c95a3-5e81-49f6-8149-afdea5e03ddc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.176130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6c5c95a3-5e81-49f6-8149-afdea5e03ddc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.176693 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6c5c95a3-5e81-49f6-8149-afdea5e03ddc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.351577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6c5c95a3-5e81-49f6-8149-afdea5e03ddc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.371215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6c5c95a3-5e81-49f6-8149-afdea5e03ddc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.229155 Jul 18 16:52:12.373241 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 135/258] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:12 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:12.717732 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7a135a3e-a8b2-44b0-8d9f-25953d7ef2f6 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:12.718346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7a135a3e-a8b2-44b0-8d9f-25953d7ef2f6 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:12.721566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:12.727784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7a135a3e-a8b2-44b0-8d9f-25953d7ef2f6 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.728229 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7a135a3e-a8b2-44b0-8d9f-25953d7ef2f6 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.729044 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7a135a3e-a8b2-44b0-8d9f-25953d7ef2f6 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.729591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7a135a3e-a8b2-44b0-8d9f-25953d7ef2f6 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.950594 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7a135a3e-a8b2-44b0-8d9f-25953d7ef2f6 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.964782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7a135a3e-a8b2-44b0-8d9f-25953d7ef2f6 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1471 microversion: 2.1 time: 0.246385 Jul 18 16:52:12.964782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 124/259] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:12 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:12.968955 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-974c8a2f-aa69-4b83-b20b-f1a907125e45 req-1c385e3b-b54c-446d-89f2-9ffcb02c3156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd22712-96fb-4fad-a26f-0ce58aec26ba", "name": "network-vif-deleted", "tag": "0b8fb609-49a9-4aa7-a782-59523d1052fc"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:12.979344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-974c8a2f-aa69-4b83-b20b-f1a907125e45 req-1c385e3b-b54c-446d-89f2-9ffcb02c3156 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.979944 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-974c8a2f-aa69-4b83-b20b-f1a907125e45 req-1c385e3b-b54c-446d-89f2-9ffcb02c3156 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.992591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-974c8a2f-aa69-4b83-b20b-f1a907125e45 req-1c385e3b-b54c-446d-89f2-9ffcb02c3156 service nova] Creating event network-vif-deleted:0b8fb609-49a9-4aa7-a782-59523d1052fc for instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba on hv-cinder-84617 Jul 18 16:52:12.997932 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-974c8a2f-aa69-4b83-b20b-f1a907125e45 req-1c385e3b-b54c-446d-89f2-9ffcb02c3156 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036056 Jul 18 16:52:12.999297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 136/260] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:52:13.390337 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d631e834-52ff-4d3b-afdd-73ed301f15ef tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:13.391538 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d631e834-52ff-4d3b-afdd-73ed301f15ef tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:13.398846 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d631e834-52ff-4d3b-afdd-73ed301f15ef tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.399698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d631e834-52ff-4d3b-afdd-73ed301f15ef tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.400735 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d631e834-52ff-4d3b-afdd-73ed301f15ef tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.401521 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d631e834-52ff-4d3b-afdd-73ed301f15ef tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.549404 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d631e834-52ff-4d3b-afdd-73ed301f15ef tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:13.558111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d631e834-52ff-4d3b-afdd-73ed301f15ef tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.172650 Jul 18 16:52:13.558693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 125/261] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:13 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:13.978072 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:13.978757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:13.986758 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.987200 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.987963 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.988396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.028661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.029306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.029765 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lazy-loading 'fault' on Instance uuid 0cd22712-96fb-4fad-a26f-0ce58aec26ba {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:52:14.077082 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb40c15365c14eb6ae597be773bafc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac8a7f26f6423fb63683053905a4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:14.086340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-979f1fca-73ce-4830-b335-01cd6415602b tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 200 len: 1305 microversion: 2.1 time: 0.112342 Jul 18 16:52:14.086919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 137/262] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:13 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:14.577663 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-54b92908-dc5d-4ae3-ae7f-8559e06b9ed9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:14.578425 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-54b92908-dc5d-4ae3-ae7f-8559e06b9ed9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:14.586248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54b92908-dc5d-4ae3-ae7f-8559e06b9ed9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.586615 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54b92908-dc5d-4ae3-ae7f-8559e06b9ed9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.587687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54b92908-dc5d-4ae3-ae7f-8559e06b9ed9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:14.588125 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54b92908-dc5d-4ae3-ae7f-8559e06b9ed9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.724372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-54b92908-dc5d-4ae3-ae7f-8559e06b9ed9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:14.732272 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-54b92908-dc5d-4ae3-ae7f-8559e06b9ed9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.159367 Jul 18 16:52:14.738784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 126/263] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:14 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:15.103695 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:15.104383 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] [instance: 0cd22712-96fb-4fad-a26f-0ce58aec26ba] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:15.110429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.117478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.117478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.117478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.125545 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] HTTP exception thrown: Instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba could not be found. Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Request method failure captured: Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba HTTP/1.1 Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y-esH-8s46-yQRPp3V5oixxkZkmogHNFaVqCdcCWWXddTxSl9MUxQutwBY-B8USuH1ANIDEDvGQgPG-Y1FDszlgojWIM757k0HREiEhSzGF_jU6UtCgZA-h9ypNdQHxz4ixSF7SS_SCIjVOy23WJeZMi2oioglGsnDvQRElZrnTxB0 Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: b4ac8a7f26f6423fb63683053905a4fe Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesNegativeTest-918040020 Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:52:15.127205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b4ac8a7f26f6423fb63683053905a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b4ac8a7f26f6423fb63683053905a4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b4ac8a7f26f6423fb63683053905a4fe", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b4ac8a7f26f6423fb63683053905a4fe"}]}] Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesNegativeTest-918040020 Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: b4ac8a7f26f6423fb63683053905a4fe Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesNegativeTest-918040020 Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesNegativeTest-918040020-project Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: cb40c15365c14eb6ae597be773bafc3a Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesNegativeTest-918040020-project Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba could not be found. Jul 18 16:52:15.128776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '0cd22712-96fb-4fad-a26f-0ce58aec26ba'} Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba could not be found. Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:52:15.129730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba could not be found. Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba could not be found. Jul 18 16:52:15.130902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:15.131926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] Returning 404 to user: Instance 0cd22712-96fb-4fad-a26f-0ce58aec26ba could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:52:15.131926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-42ca16b9-82a5-497f-913a-4b9f0d8eea47 tempest-VolumesNegativeTest-918040020 tempest-VolumesNegativeTest-918040020-project] 10.222.0.88 "GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba" status: 404 len: 111 microversion: 2.1 time: 0.028897 Jul 18 16:52:15.131926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 138/264] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:15 2022] GET /compute/v2.1/servers/0cd22712-96fb-4fad-a26f-0ce58aec26ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:52:15.329117 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f51bfd2b-9977-4cc8-a049-64cd33b686da tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c17db7c2-93ef-4218-b0ae-891311e8ac87"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:15.330624 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f51bfd2b-9977-4cc8-a049-64cd33b686da tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:15.339058 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f51bfd2b-9977-4cc8-a049-64cd33b686da tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.339508 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f51bfd2b-9977-4cc8-a049-64cd33b686da tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.340294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f51bfd2b-9977-4cc8-a049-64cd33b686da tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.340734 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f51bfd2b-9977-4cc8-a049-64cd33b686da tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.749859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3a992cfa-5ca3-48df-a156-f7764e381573 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:15.750933 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3a992cfa-5ca3-48df-a156-f7764e381573 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:15.758015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3a992cfa-5ca3-48df-a156-f7764e381573 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.758471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3a992cfa-5ca3-48df-a156-f7764e381573 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.759265 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3a992cfa-5ca3-48df-a156-f7764e381573 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.759709 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3a992cfa-5ca3-48df-a156-f7764e381573 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.973435 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3a992cfa-5ca3-48df-a156-f7764e381573 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:15.983374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3a992cfa-5ca3-48df-a156-f7764e381573 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.238771 Jul 18 16:52:15.984263 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 139/265] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:15 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:16.303525 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f51bfd2b-9977-4cc8-a049-64cd33b686da tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.979166 Jul 18 16:52:16.310540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 127/266] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:52:15 2022] POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/os-volume_attachments => generated 194 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:17.004679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-021e6b73-04c3-40f5-8aa1-4cd49770399f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:17.005331 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-021e6b73-04c3-40f5-8aa1-4cd49770399f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:17.013781 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-021e6b73-04c3-40f5-8aa1-4cd49770399f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.014417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-021e6b73-04c3-40f5-8aa1-4cd49770399f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.015696 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-021e6b73-04c3-40f5-8aa1-4cd49770399f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.016591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-021e6b73-04c3-40f5-8aa1-4cd49770399f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.045017 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:17.197476 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-021e6b73-04c3-40f5-8aa1-4cd49770399f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:17.205900 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-021e6b73-04c3-40f5-8aa1-4cd49770399f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.207167 Jul 18 16:52:17.206470 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 140/267] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:16 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:18.226483 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a0adc66c-8d9f-43d3-aaa4-0fb4eecfbc42 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:18.227183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a0adc66c-8d9f-43d3-aaa4-0fb4eecfbc42 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:18.233564 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a0adc66c-8d9f-43d3-aaa4-0fb4eecfbc42 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:18.234013 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a0adc66c-8d9f-43d3-aaa4-0fb4eecfbc42 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:18.235219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a0adc66c-8d9f-43d3-aaa4-0fb4eecfbc42 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:18.235584 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a0adc66c-8d9f-43d3-aaa4-0fb4eecfbc42 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:18.392709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a0adc66c-8d9f-43d3-aaa4-0fb4eecfbc42 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:18.412522 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a0adc66c-8d9f-43d3-aaa4-0fb4eecfbc42 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.178777 Jul 18 16:52:18.412522 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 128/268] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:18 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:19.417482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bbe79884-658a-4a5f-b61b-64d5fc40b033 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:19.418078 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bbe79884-658a-4a5f-b61b-64d5fc40b033 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:19.424788 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bbe79884-658a-4a5f-b61b-64d5fc40b033 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.425262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bbe79884-658a-4a5f-b61b-64d5fc40b033 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:19.426093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bbe79884-658a-4a5f-b61b-64d5fc40b033 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.426524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bbe79884-658a-4a5f-b61b-64d5fc40b033 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:19.576390 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-bbe79884-658a-4a5f-b61b-64d5fc40b033 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:19.584221 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bbe79884-658a-4a5f-b61b-64d5fc40b033 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.170433 Jul 18 16:52:19.585181 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 141/269] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:19 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:20.602239 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-54c45610-c7f9-470e-b438-fb2d697fbf8f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:20.603002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-54c45610-c7f9-470e-b438-fb2d697fbf8f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:20.609560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54c45610-c7f9-470e-b438-fb2d697fbf8f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:20.610046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54c45610-c7f9-470e-b438-fb2d697fbf8f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:20.611570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54c45610-c7f9-470e-b438-fb2d697fbf8f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:20.612092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54c45610-c7f9-470e-b438-fb2d697fbf8f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:20.787657 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-54c45610-c7f9-470e-b438-fb2d697fbf8f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:20.810203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-54c45610-c7f9-470e-b438-fb2d697fbf8f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.208870 Jul 18 16:52:20.810203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 129/270] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:20 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:21.830883 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-86eb9cfc-8182-4988-9868-a81ccc3f376a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:21.830883 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-86eb9cfc-8182-4988-9868-a81ccc3f376a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:21.835970 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-86eb9cfc-8182-4988-9868-a81ccc3f376a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:21.836524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-86eb9cfc-8182-4988-9868-a81ccc3f376a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:21.837233 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-86eb9cfc-8182-4988-9868-a81ccc3f376a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:21.837840 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-86eb9cfc-8182-4988-9868-a81ccc3f376a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:22.014478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-86eb9cfc-8182-4988-9868-a81ccc3f376a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:22.022065 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-86eb9cfc-8182-4988-9868-a81ccc3f376a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.197070 Jul 18 16:52:22.022630 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 142/271] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:21 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:23.040175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-80a7f898-e191-4543-9e89-2adef82dcc5a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:23.041117 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-80a7f898-e191-4543-9e89-2adef82dcc5a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:23.052605 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80a7f898-e191-4543-9e89-2adef82dcc5a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:23.053107 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80a7f898-e191-4543-9e89-2adef82dcc5a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:23.053899 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80a7f898-e191-4543-9e89-2adef82dcc5a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:23.054260 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80a7f898-e191-4543-9e89-2adef82dcc5a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:23.192825 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-80a7f898-e191-4543-9e89-2adef82dcc5a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:23.200301 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-80a7f898-e191-4543-9e89-2adef82dcc5a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.163968 Jul 18 16:52:23.201104 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 130/272] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:23 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:24.218010 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6342b892-1b62-48cf-ba1c-db633d72564c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:24.218678 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6342b892-1b62-48cf-ba1c-db633d72564c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:24.224714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6342b892-1b62-48cf-ba1c-db633d72564c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:24.225185 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6342b892-1b62-48cf-ba1c-db633d72564c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:24.225973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6342b892-1b62-48cf-ba1c-db633d72564c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:24.226396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6342b892-1b62-48cf-ba1c-db633d72564c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:24.412870 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6342b892-1b62-48cf-ba1c-db633d72564c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:24.420724 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6342b892-1b62-48cf-ba1c-db633d72564c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.206441 Jul 18 16:52:24.429374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 143/273] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:24 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:25.438279 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ea1b8c3f-3b01-40e4-ad56-83c09a5b596b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:25.438976 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ea1b8c3f-3b01-40e4-ad56-83c09a5b596b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:25.446136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea1b8c3f-3b01-40e4-ad56-83c09a5b596b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.446589 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea1b8c3f-3b01-40e4-ad56-83c09a5b596b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:25.447423 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea1b8c3f-3b01-40e4-ad56-83c09a5b596b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.447875 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea1b8c3f-3b01-40e4-ad56-83c09a5b596b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:25.591072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ea1b8c3f-3b01-40e4-ad56-83c09a5b596b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:25.599216 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ea1b8c3f-3b01-40e4-ad56-83c09a5b596b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.164822 Jul 18 16:52:25.599846 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 131/274] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:25 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:26.616365 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-14968944-a58d-4dc8-a55c-c04a33ea8a28 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:26.616980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-14968944-a58d-4dc8-a55c-c04a33ea8a28 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:26.623820 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-14968944-a58d-4dc8-a55c-c04a33ea8a28 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:26.624270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-14968944-a58d-4dc8-a55c-c04a33ea8a28 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:26.625296 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-14968944-a58d-4dc8-a55c-c04a33ea8a28 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:26.625728 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-14968944-a58d-4dc8-a55c-c04a33ea8a28 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:26.808670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-14968944-a58d-4dc8-a55c-c04a33ea8a28 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:26.816485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-14968944-a58d-4dc8-a55c-c04a33ea8a28 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.203987 Jul 18 16:52:26.817462 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 144/275] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:26 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:27.834680 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8e52d616-1901-431b-8029-55371e1e9fce tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:27.842841 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8e52d616-1901-431b-8029-55371e1e9fce tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:27.857024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8e52d616-1901-431b-8029-55371e1e9fce tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:27.857024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8e52d616-1901-431b-8029-55371e1e9fce tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:27.857919 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8e52d616-1901-431b-8029-55371e1e9fce tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:27.858708 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8e52d616-1901-431b-8029-55371e1e9fce tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.040789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8e52d616-1901-431b-8029-55371e1e9fce tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:28.053388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8e52d616-1901-431b-8029-55371e1e9fce tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.223066 Jul 18 16:52:28.053980 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 132/276] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:27 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:28.273054 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2f8ce8d6-5904-4647-a5fc-461ad7360525 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:28.282306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f8ce8d6-5904-4647-a5fc-461ad7360525 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:28.283511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f8ce8d6-5904-4647-a5fc-461ad7360525 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.357837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2f8ce8d6-5904-4647-a5fc-461ad7360525 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Going to try to stop instance {{(pid=124753) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 16:52:28.579140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2f8ce8d6-5904-4647-a5fc-461ad7360525 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/action" status: 202 len: 0 microversion: 2.1 time: 0.309370 Jul 18 16:52:28.579140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 145/277] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:52:28 2022] POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:52:28.590131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-31067929-ca20-4f6d-962b-ae57220ff691 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:28.590910 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-31067929-ca20-4f6d-962b-ae57220ff691 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:28.599139 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-31067929-ca20-4f6d-962b-ae57220ff691 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:28.599587 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-31067929-ca20-4f6d-962b-ae57220ff691 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.600371 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-31067929-ca20-4f6d-962b-ae57220ff691 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:28.601838 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-31067929-ca20-4f6d-962b-ae57220ff691 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.791815 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-31067929-ca20-4f6d-962b-ae57220ff691 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:28.801675 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-31067929-ca20-4f6d-962b-ae57220ff691 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.215276 Jul 18 16:52:28.802258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 133/278] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:28 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:29.071860 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3b799264-08e0-4b73-82c0-555761e92bfb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:29.072609 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3b799264-08e0-4b73-82c0-555761e92bfb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:29.080426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3b799264-08e0-4b73-82c0-555761e92bfb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.080899 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3b799264-08e0-4b73-82c0-555761e92bfb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.081706 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3b799264-08e0-4b73-82c0-555761e92bfb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.082135 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3b799264-08e0-4b73-82c0-555761e92bfb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.411285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3b799264-08e0-4b73-82c0-555761e92bfb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:29.429928 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3b799264-08e0-4b73-82c0-555761e92bfb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.362323 Jul 18 16:52:29.433106 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 146/279] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:29 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:29.820747 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-aceb7168-d3ea-4a01-a9ef-ef92006a30a2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:29.821368 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-aceb7168-d3ea-4a01-a9ef-ef92006a30a2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:29.827958 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aceb7168-d3ea-4a01-a9ef-ef92006a30a2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.828406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aceb7168-d3ea-4a01-a9ef-ef92006a30a2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.829215 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aceb7168-d3ea-4a01-a9ef-ef92006a30a2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.829653 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aceb7168-d3ea-4a01-a9ef-ef92006a30a2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.984016 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-aceb7168-d3ea-4a01-a9ef-ef92006a30a2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:29.995481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-aceb7168-d3ea-4a01-a9ef-ef92006a30a2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.178367 Jul 18 16:52:29.996351 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 134/280] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:29 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:30.447480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-258c80c8-a72a-4dc6-b52d-80a589a6c61e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:30.448224 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-258c80c8-a72a-4dc6-b52d-80a589a6c61e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:30.454362 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-258c80c8-a72a-4dc6-b52d-80a589a6c61e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:30.455423 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-258c80c8-a72a-4dc6-b52d-80a589a6c61e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:30.456199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-258c80c8-a72a-4dc6-b52d-80a589a6c61e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:30.456646 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-258c80c8-a72a-4dc6-b52d-80a589a6c61e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:30.592340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-258c80c8-a72a-4dc6-b52d-80a589a6c61e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:30.600422 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-258c80c8-a72a-4dc6-b52d-80a589a6c61e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.156801 Jul 18 16:52:30.600997 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 147/281] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:30 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:31.018257 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cf4b6ecd-3308-40b9-b678-d775979187a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:31.018861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cf4b6ecd-3308-40b9-b678-d775979187a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:31.026615 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ecd-3308-40b9-b678-d775979187a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:31.027053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ecd-3308-40b9-b678-d775979187a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:31.027822 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ecd-3308-40b9-b678-d775979187a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:31.028259 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cf4b6ecd-3308-40b9-b678-d775979187a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:31.155669 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cf4b6ecd-3308-40b9-b678-d775979187a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:31.164060 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cf4b6ecd-3308-40b9-b678-d775979187a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.149679 Jul 18 16:52:31.164642 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 135/282] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:31 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:31.617149 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-821b62fa-6087-47c9-b903-c1281a5c145f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:31.617711 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-821b62fa-6087-47c9-b903-c1281a5c145f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:31.623804 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-821b62fa-6087-47c9-b903-c1281a5c145f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:31.624239 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-821b62fa-6087-47c9-b903-c1281a5c145f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:31.625146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-821b62fa-6087-47c9-b903-c1281a5c145f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:31.625468 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-821b62fa-6087-47c9-b903-c1281a5c145f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:31.757507 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-821b62fa-6087-47c9-b903-c1281a5c145f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:31.765041 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-821b62fa-6087-47c9-b903-c1281a5c145f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.151853 Jul 18 16:52:31.765628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 148/283] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:31 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:32.181866 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9cdd01fd-3ce5-43a5-8026-232eb3f38d98 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:32.182577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9cdd01fd-3ce5-43a5-8026-232eb3f38d98 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:32.190134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9cdd01fd-3ce5-43a5-8026-232eb3f38d98 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:32.190669 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9cdd01fd-3ce5-43a5-8026-232eb3f38d98 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:32.191513 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9cdd01fd-3ce5-43a5-8026-232eb3f38d98 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:32.192073 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9cdd01fd-3ce5-43a5-8026-232eb3f38d98 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:32.197759 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:32.336748 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9cdd01fd-3ce5-43a5-8026-232eb3f38d98 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:32.345110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9cdd01fd-3ce5-43a5-8026-232eb3f38d98 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.167485 Jul 18 16:52:32.346130 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 136/284] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:32 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:32.782278 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b692be44-5b0f-4620-b2d2-fcf06b287f6a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:32.783423 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b692be44-5b0f-4620-b2d2-fcf06b287f6a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:32.789751 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b692be44-5b0f-4620-b2d2-fcf06b287f6a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:32.790205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b692be44-5b0f-4620-b2d2-fcf06b287f6a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:32.790973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b692be44-5b0f-4620-b2d2-fcf06b287f6a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:32.791416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b692be44-5b0f-4620-b2d2-fcf06b287f6a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:32.920378 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b692be44-5b0f-4620-b2d2-fcf06b287f6a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:32.928560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b692be44-5b0f-4620-b2d2-fcf06b287f6a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.150143 Jul 18 16:52:32.929159 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 149/285] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:32 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:33.363539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5de5e2f3-4877-4edf-8967-3f27c5d2c56e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:33.364142 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5de5e2f3-4877-4edf-8967-3f27c5d2c56e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:33.370977 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5de5e2f3-4877-4edf-8967-3f27c5d2c56e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:33.371431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5de5e2f3-4877-4edf-8967-3f27c5d2c56e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:33.372198 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5de5e2f3-4877-4edf-8967-3f27c5d2c56e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:33.372637 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5de5e2f3-4877-4edf-8967-3f27c5d2c56e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:33.519468 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5de5e2f3-4877-4edf-8967-3f27c5d2c56e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:33.527549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5de5e2f3-4877-4edf-8967-3f27c5d2c56e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.168815 Jul 18 16:52:33.528121 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 137/286] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:33 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:33.945555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2bf84757-0d8f-464b-8383-dae743281a39 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:33.946159 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2bf84757-0d8f-464b-8383-dae743281a39 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:33.952257 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2bf84757-0d8f-464b-8383-dae743281a39 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:33.952703 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2bf84757-0d8f-464b-8383-dae743281a39 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:33.953526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2bf84757-0d8f-464b-8383-dae743281a39 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:33.953958 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2bf84757-0d8f-464b-8383-dae743281a39 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.086090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2bf84757-0d8f-464b-8383-dae743281a39 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:34.093423 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2bf84757-0d8f-464b-8383-dae743281a39 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.151699 Jul 18 16:52:34.093973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 150/287] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:33 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:34.544784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-dc5bbeb0-e5c4-4a29-a1e8-5b1f9b6c13e8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:34.545426 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-dc5bbeb0-e5c4-4a29-a1e8-5b1f9b6c13e8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:34.552663 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dc5bbeb0-e5c4-4a29-a1e8-5b1f9b6c13e8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.553140 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dc5bbeb0-e5c4-4a29-a1e8-5b1f9b6c13e8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.553911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dc5bbeb0-e5c4-4a29-a1e8-5b1f9b6c13e8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.554465 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dc5bbeb0-e5c4-4a29-a1e8-5b1f9b6c13e8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.825796 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-dc5bbeb0-e5c4-4a29-a1e8-5b1f9b6c13e8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:34.833774 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-dc5bbeb0-e5c4-4a29-a1e8-5b1f9b6c13e8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.292874 Jul 18 16:52:34.834622 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 138/288] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:34 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:35.110800 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a5f7c7af-c662-49fb-9368-6745f5b9e5cd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:35.111319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a5f7c7af-c662-49fb-9368-6745f5b9e5cd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:35.117681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a5f7c7af-c662-49fb-9368-6745f5b9e5cd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:35.118142 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a5f7c7af-c662-49fb-9368-6745f5b9e5cd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:35.118976 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a5f7c7af-c662-49fb-9368-6745f5b9e5cd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:35.119387 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a5f7c7af-c662-49fb-9368-6745f5b9e5cd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:35.263268 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a5f7c7af-c662-49fb-9368-6745f5b9e5cd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:35.271998 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a5f7c7af-c662-49fb-9368-6745f5b9e5cd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.165056 Jul 18 16:52:35.272597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 151/289] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:35 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:35.742222 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1966050009", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1419738871", "security_groups": [{"name": "tempest-secgroup-smoke-1079799154"}], "networks": [{"uuid": "cf5f2b6c-7b29-4c87-b4a7-9c7f65222fb1"}], "block_device_mapping_v2": [{"uuid": "82eb8c24-b81a-41ea-ae4d-c4c6825f3167", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:35.852155 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-06c128fc-b6ad-4c33-a3f6-787ff52ef618 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:35.852764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-06c128fc-b6ad-4c33-a3f6-787ff52ef618 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:35.859357 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-06c128fc-b6ad-4c33-a3f6-787ff52ef618 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:35.859814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-06c128fc-b6ad-4c33-a3f6-787ff52ef618 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:35.861197 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-06c128fc-b6ad-4c33-a3f6-787ff52ef618 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:35.861639 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-06c128fc-b6ad-4c33-a3f6-787ff52ef618 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:35.873895 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] validate_networks() for [('cf5f2b6c-7b29-4c87-b4a7-9c7f65222fb1', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:52:36.017713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-06c128fc-b6ad-4c33-a3f6-787ff52ef618 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:36.026890 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-06c128fc-b6ad-4c33-a3f6-787ff52ef618 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.179229 Jul 18 16:52:36.027945 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 152/290] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:35 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:36.289456 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e801afb1-80ae-4c48-8c3e-49102604ea3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:36.290096 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e801afb1-80ae-4c48-8c3e-49102604ea3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:36.296399 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e801afb1-80ae-4c48-8c3e-49102604ea3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.296915 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e801afb1-80ae-4c48-8c3e-49102604ea3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.297692 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e801afb1-80ae-4c48-8c3e-49102604ea3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.298658 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e801afb1-80ae-4c48-8c3e-49102604ea3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.308006 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:52:36.308414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:52:36.308875 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:52:36.309349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:52:36.309753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:52:36.321185 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.321665 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.322470 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.323084 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.347199 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Getting quotas for project e3e2c4fb7f354179a90bfa7d963aa50c. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:52:36.351485 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Getting quotas for user 8016e561397f4b4faca9e03343d51355 and project e3e2c4fb7f354179a90bfa7d963aa50c. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:52:36.417690 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:52:36.419810 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82eb8c24-b81a-41ea-ae4d-c4c6825f3167',volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:52:36.446817 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e801afb1-80ae-4c48-8c3e-49102604ea3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:36.456837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e801afb1-80ae-4c48-8c3e-49102604ea3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.171449 Jul 18 16:52:36.457549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 153/291] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:36 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:36.814912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-50943c3e-772e-4098-9f29-df24273cd9db tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.076506 Jul 18 16:52:36.815975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 139/292] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:52:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:52:36.828008 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2f204af2-4544-4c15-b8a3-6945d970e3fb tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:36.828750 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2f204af2-4544-4c15-b8a3-6945d970e3fb tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:36.888076 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2f204af2-4544-4c15-b8a3-6945d970e3fb tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:36.896844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2f204af2-4544-4c15-b8a3-6945d970e3fb tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1089 microversion: 2.1 time: 0.073730 Jul 18 16:52:36.897464 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 154/293] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:36 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:37.045223 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0365d02b-6de4-462b-bbff-40ee8772f9ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:37.045879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0365d02b-6de4-462b-bbff-40ee8772f9ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:37.052218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0365d02b-6de4-462b-bbff-40ee8772f9ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.052695 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0365d02b-6de4-462b-bbff-40ee8772f9ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.053505 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0365d02b-6de4-462b-bbff-40ee8772f9ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.053940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0365d02b-6de4-462b-bbff-40ee8772f9ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.195291 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0365d02b-6de4-462b-bbff-40ee8772f9ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:37.203427 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0365d02b-6de4-462b-bbff-40ee8772f9ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.162289 Jul 18 16:52:37.204092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 140/294] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:37 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:37.475722 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1c963272-160b-4035-a576-ac720c025379 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:37.476360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1c963272-160b-4035-a576-ac720c025379 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:37.482414 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1c963272-160b-4035-a576-ac720c025379 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.482869 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1c963272-160b-4035-a576-ac720c025379 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.483629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1c963272-160b-4035-a576-ac720c025379 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.484070 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1c963272-160b-4035-a576-ac720c025379 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.632900 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1c963272-160b-4035-a576-ac720c025379 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:37.641456 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1c963272-160b-4035-a576-ac720c025379 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.169546 Jul 18 16:52:37.642041 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 155/295] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:37 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:37.914595 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-587c957e-ce50-45c6-a278-72e403de7452 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:37.915202 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-587c957e-ce50-45c6-a278-72e403de7452 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:37.971645 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-587c957e-ce50-45c6-a278-72e403de7452 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:37.978807 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-587c957e-ce50-45c6-a278-72e403de7452 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1089 microversion: 2.1 time: 0.068049 Jul 18 16:52:37.979431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 141/296] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:37 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:38.222931 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7fda0a86-2d2c-4f7b-8e0e-23b8a7b4d85a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:38.223552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7fda0a86-2d2c-4f7b-8e0e-23b8a7b4d85a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:38.230863 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7fda0a86-2d2c-4f7b-8e0e-23b8a7b4d85a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.231349 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7fda0a86-2d2c-4f7b-8e0e-23b8a7b4d85a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.232246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7fda0a86-2d2c-4f7b-8e0e-23b8a7b4d85a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.232664 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7fda0a86-2d2c-4f7b-8e0e-23b8a7b4d85a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.388677 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7fda0a86-2d2c-4f7b-8e0e-23b8a7b4d85a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:38.399676 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7fda0a86-2d2c-4f7b-8e0e-23b8a7b4d85a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.181411 Jul 18 16:52:38.400609 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 156/297] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:38 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:38.660392 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8dd54926-d1ac-49d2-8189-51ffac88d3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:38.661292 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8dd54926-d1ac-49d2-8189-51ffac88d3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:38.667216 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8dd54926-d1ac-49d2-8189-51ffac88d3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.667623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8dd54926-d1ac-49d2-8189-51ffac88d3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.668453 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8dd54926-d1ac-49d2-8189-51ffac88d3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:38.668952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8dd54926-d1ac-49d2-8189-51ffac88d3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:38.836801 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8dd54926-d1ac-49d2-8189-51ffac88d3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:38.846592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8dd54926-d1ac-49d2-8189-51ffac88d3df tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.191098 Jul 18 16:52:38.847177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 142/298] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:38 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:38.997206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-164e8c0d-6d71-4c14-8ba9-d6a356e05103 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:38.997820 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-164e8c0d-6d71-4c14-8ba9-d6a356e05103 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:39.003903 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-164e8c0d-6d71-4c14-8ba9-d6a356e05103 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.004351 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-164e8c0d-6d71-4c14-8ba9-d6a356e05103 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.008016 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-164e8c0d-6d71-4c14-8ba9-d6a356e05103 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.008016 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-164e8c0d-6d71-4c14-8ba9-d6a356e05103 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.009638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:39.071335 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-164e8c0d-6d71-4c14-8ba9-d6a356e05103 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:39.079009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-164e8c0d-6d71-4c14-8ba9-d6a356e05103 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1187 microversion: 2.1 time: 0.085786 Jul 18 16:52:39.080095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 157/299] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:38 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:39.419082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2a69396c-d5e1-49a7-aa6d-6d54589be93a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:39.419951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2a69396c-d5e1-49a7-aa6d-6d54589be93a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:39.428788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2a69396c-d5e1-49a7-aa6d-6d54589be93a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.434187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2a69396c-d5e1-49a7-aa6d-6d54589be93a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.434187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2a69396c-d5e1-49a7-aa6d-6d54589be93a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.434187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2a69396c-d5e1-49a7-aa6d-6d54589be93a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.647497 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2a69396c-d5e1-49a7-aa6d-6d54589be93a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:39.663427 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2a69396c-d5e1-49a7-aa6d-6d54589be93a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1723 microversion: 2.1 time: 0.248189 Jul 18 16:52:39.664262 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 143/300] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:39 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:39.864570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cbf60681-9382-45fd-a5dd-9e06498050bd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:39.865380 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cbf60681-9382-45fd-a5dd-9e06498050bd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:39.871921 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cbf60681-9382-45fd-a5dd-9e06498050bd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.872380 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cbf60681-9382-45fd-a5dd-9e06498050bd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.873199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cbf60681-9382-45fd-a5dd-9e06498050bd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.873641 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cbf60681-9382-45fd-a5dd-9e06498050bd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.014635 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-cbf60681-9382-45fd-a5dd-9e06498050bd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:40.022780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cbf60681-9382-45fd-a5dd-9e06498050bd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.162781 Jul 18 16:52:40.023344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 158/301] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:39 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:40.096966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a54a2b4e-3fe5-4a09-be43-15a039be461b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:40.097575 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a54a2b4e-3fe5-4a09-be43-15a039be461b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:40.103941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a54a2b4e-3fe5-4a09-be43-15a039be461b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.104298 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a54a2b4e-3fe5-4a09-be43-15a039be461b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.105123 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a54a2b4e-3fe5-4a09-be43-15a039be461b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.105566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a54a2b4e-3fe5-4a09-be43-15a039be461b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.180539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a54a2b4e-3fe5-4a09-be43-15a039be461b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:40.190009 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a54a2b4e-3fe5-4a09-be43-15a039be461b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1205 microversion: 2.1 time: 0.096989 Jul 18 16:52:40.190910 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 144/302] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:40 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:40.687240 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-41c2bcac-09e1-44d4-816a-8ca752a57686 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:40.688107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-41c2bcac-09e1-44d4-816a-8ca752a57686 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:40.690868 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=58 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:40.697991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-41c2bcac-09e1-44d4-816a-8ca752a57686 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.700764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-41c2bcac-09e1-44d4-816a-8ca752a57686 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.700764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-41c2bcac-09e1-44d4-816a-8ca752a57686 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.700764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-41c2bcac-09e1-44d4-816a-8ca752a57686 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.863668 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-41c2bcac-09e1-44d4-816a-8ca752a57686 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:40.874234 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-41c2bcac-09e1-44d4-816a-8ca752a57686 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1700 microversion: 2.1 time: 0.196497 Jul 18 16:52:40.875404 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 159/303] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:40 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1700 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:40.891008 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-dde0fcfb-8964-4c9a-90ab-81ef4343922f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:40.901558 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dde0fcfb-8964-4c9a-90ab-81ef4343922f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.902093 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dde0fcfb-8964-4c9a-90ab-81ef4343922f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.976414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-dde0fcfb-8964-4c9a-90ab-81ef4343922f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Going to try to start instance {{(pid=124754) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 16:52:41.039378 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-db870515-192c-4bc8-a0fa-c05c40437740 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:41.039984 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-db870515-192c-4bc8-a0fa-c05c40437740 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:41.046036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db870515-192c-4bc8-a0fa-c05c40437740 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.046484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db870515-192c-4bc8-a0fa-c05c40437740 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.047243 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db870515-192c-4bc8-a0fa-c05c40437740 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.047676 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db870515-192c-4bc8-a0fa-c05c40437740 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.192323 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-db870515-192c-4bc8-a0fa-c05c40437740 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:41.194486 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-dde0fcfb-8964-4c9a-90ab-81ef4343922f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/action" status: 202 len: 0 microversion: 2.1 time: 0.307182 Jul 18 16:52:41.195987 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 145/304] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:52:40 2022] POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:52:41.205645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-db870515-192c-4bc8-a0fa-c05c40437740 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.166650 Jul 18 16:52:41.206899 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 160/305] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:41 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:41.207123 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8ef5b0d7-02d4-4bf7-a25b-32e7a3fabac0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:41.207825 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8ef5b0d7-02d4-4bf7-a25b-32e7a3fabac0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:41.218569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c86fce2f-0878-4eae-b134-65d572cd4ffa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:41.219367 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c86fce2f-0878-4eae-b134-65d572cd4ffa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:41.226954 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8ef5b0d7-02d4-4bf7-a25b-32e7a3fabac0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.230543 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c86fce2f-0878-4eae-b134-65d572cd4ffa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.230900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8ef5b0d7-02d4-4bf7-a25b-32e7a3fabac0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.231381 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c86fce2f-0878-4eae-b134-65d572cd4ffa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.232319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c86fce2f-0878-4eae-b134-65d572cd4ffa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.232671 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8ef5b0d7-02d4-4bf7-a25b-32e7a3fabac0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.232963 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c86fce2f-0878-4eae-b134-65d572cd4ffa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.233562 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8ef5b0d7-02d4-4bf7-a25b-32e7a3fabac0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.503698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c86fce2f-0878-4eae-b134-65d572cd4ffa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:41.517618 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c86fce2f-0878-4eae-b134-65d572cd4ffa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1273 microversion: 2.1 time: 0.302446 Jul 18 16:52:41.519894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 161/306] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:41 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:41.577227 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8ef5b0d7-02d4-4bf7-a25b-32e7a3fabac0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:41.587564 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8ef5b0d7-02d4-4bf7-a25b-32e7a3fabac0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1709 microversion: 2.1 time: 0.385921 Jul 18 16:52:41.589484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 146/307] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:41 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1709 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:41.904074 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-e2916e14-3660-4300-aa7e-147ab96f72ad req-f072fbe9-6221-44e3-b538-1caa59dc8174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5983e4e-fd93-4b05-b152-8c5c488364f6", "tag": "1e587242-bec2-4c2e-ae22-9a164230f521"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:41.913360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-e2916e14-3660-4300-aa7e-147ab96f72ad req-f072fbe9-6221-44e3-b538-1caa59dc8174 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.913903 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-e2916e14-3660-4300-aa7e-147ab96f72ad req-f072fbe9-6221-44e3-b538-1caa59dc8174 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.927232 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-e2916e14-3660-4300-aa7e-147ab96f72ad req-f072fbe9-6221-44e3-b538-1caa59dc8174 service nova] Creating event network-changed:1e587242-bec2-4c2e-ae22-9a164230f521 for instance f5983e4e-fd93-4b05-b152-8c5c488364f6 on hv-cinder-84617 Jul 18 16:52:41.940195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-e2916e14-3660-4300-aa7e-147ab96f72ad req-f072fbe9-6221-44e3-b538-1caa59dc8174 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040385 Jul 18 16:52:41.941437 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 162/308] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:42.223168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-20525ee5-1437-4ab6-9626-0c630b2d12e6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:42.223774 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-20525ee5-1437-4ab6-9626-0c630b2d12e6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:42.230836 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-20525ee5-1437-4ab6-9626-0c630b2d12e6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.231281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-20525ee5-1437-4ab6-9626-0c630b2d12e6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.232061 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-20525ee5-1437-4ab6-9626-0c630b2d12e6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.232475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-20525ee5-1437-4ab6-9626-0c630b2d12e6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.537152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9ea2c200-1deb-4964-9ec4-f04cdaac6e44 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:42.537789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9ea2c200-1deb-4964-9ec4-f04cdaac6e44 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:42.548545 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9ea2c200-1deb-4964-9ec4-f04cdaac6e44 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.549058 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9ea2c200-1deb-4964-9ec4-f04cdaac6e44 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.550135 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9ea2c200-1deb-4964-9ec4-f04cdaac6e44 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.550570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9ea2c200-1deb-4964-9ec4-f04cdaac6e44 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.699246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9ea2c200-1deb-4964-9ec4-f04cdaac6e44 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:42.707853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9ea2c200-1deb-4964-9ec4-f04cdaac6e44 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.175771 Jul 18 16:52:42.708464 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 163/309] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:42 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:42.714318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4939d8b9-c815-430e-b406-f0545fbff092 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:42.714938 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4939d8b9-c815-430e-b406-f0545fbff092 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:42.723523 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4939d8b9-c815-430e-b406-f0545fbff092 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.723992 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4939d8b9-c815-430e-b406-f0545fbff092 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.724789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4939d8b9-c815-430e-b406-f0545fbff092 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.725361 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4939d8b9-c815-430e-b406-f0545fbff092 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.837036 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-20525ee5-1437-4ab6-9626-0c630b2d12e6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:42.852032 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-20525ee5-1437-4ab6-9626-0c630b2d12e6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.632676 Jul 18 16:52:42.860728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 147/310] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:42 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:42.870681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4939d8b9-c815-430e-b406-f0545fbff092 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:42.880377 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4939d8b9-c815-430e-b406-f0545fbff092 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1709 microversion: 2.1 time: 0.170307 Jul 18 16:52:42.880992 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 164/311] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:42 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:43.729147 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-00260ba7-3883-461b-b854-df14dbbc60ce tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:43.730559 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-00260ba7-3883-461b-b854-df14dbbc60ce tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:43.733205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:43.738030 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00260ba7-3883-461b-b854-df14dbbc60ce tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.738508 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00260ba7-3883-461b-b854-df14dbbc60ce tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.739299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00260ba7-3883-461b-b854-df14dbbc60ce tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.739771 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00260ba7-3883-461b-b854-df14dbbc60ce tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.870992 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0322d5d9-cadc-4a68-bd5c-a27ba13b7c60 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:43.872440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0322d5d9-cadc-4a68-bd5c-a27ba13b7c60 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:43.886174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0322d5d9-cadc-4a68-bd5c-a27ba13b7c60 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.886174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0322d5d9-cadc-4a68-bd5c-a27ba13b7c60 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.886174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0322d5d9-cadc-4a68-bd5c-a27ba13b7c60 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.886174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0322d5d9-cadc-4a68-bd5c-a27ba13b7c60 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.911759 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-00260ba7-3883-461b-b854-df14dbbc60ce tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:43.924182 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-00260ba7-3883-461b-b854-df14dbbc60ce tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.202024 Jul 18 16:52:43.926536 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 148/312] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:43 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:43.939267 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-497a1e13-9b39-4719-b771-5822510feadf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:43.940567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-497a1e13-9b39-4719-b771-5822510feadf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:43.952511 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-497a1e13-9b39-4719-b771-5822510feadf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.953001 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-497a1e13-9b39-4719-b771-5822510feadf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.954581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-497a1e13-9b39-4719-b771-5822510feadf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.955028 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-497a1e13-9b39-4719-b771-5822510feadf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.052390 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0322d5d9-cadc-4a68-bd5c-a27ba13b7c60 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:44.062857 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0322d5d9-cadc-4a68-bd5c-a27ba13b7c60 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.194589 Jul 18 16:52:44.062989 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 165/313] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:43 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:44.105570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-497a1e13-9b39-4719-b771-5822510feadf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:44.114063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-497a1e13-9b39-4719-b771-5822510feadf tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1713 microversion: 2.1 time: 0.186149 Jul 18 16:52:44.114640 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 149/314] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:43 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1713 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:44.944663 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0d17d94c-6bd0-4428-8495-44c858ee9af0 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:44.945408 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0d17d94c-6bd0-4428-8495-44c858ee9af0 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:44.951946 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0d17d94c-6bd0-4428-8495-44c858ee9af0 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.952454 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0d17d94c-6bd0-4428-8495-44c858ee9af0 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.953325 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0d17d94c-6bd0-4428-8495-44c858ee9af0 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.954266 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0d17d94c-6bd0-4428-8495-44c858ee9af0 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:45.078121 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-132b0bcb-7bed-414c-8081-a1c5198b4458 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:45.079531 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-132b0bcb-7bed-414c-8081-a1c5198b4458 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:45.087090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-132b0bcb-7bed-414c-8081-a1c5198b4458 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:45.087542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-132b0bcb-7bed-414c-8081-a1c5198b4458 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:45.088467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-132b0bcb-7bed-414c-8081-a1c5198b4458 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:45.088793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-132b0bcb-7bed-414c-8081-a1c5198b4458 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:45.096400 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0d17d94c-6bd0-4428-8495-44c858ee9af0 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:45.104783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0d17d94c-6bd0-4428-8495-44c858ee9af0 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.163982 Jul 18 16:52:45.105580 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 166/315] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:44 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:45.238397 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-132b0bcb-7bed-414c-8081-a1c5198b4458 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:45.246386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-132b0bcb-7bed-414c-8081-a1c5198b4458 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.172179 Jul 18 16:52:45.246997 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 150/316] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:45 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:46.122191 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4a9f0361-dc67-49fd-b3e1-c818534f9d57 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:46.122830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4a9f0361-dc67-49fd-b3e1-c818534f9d57 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:46.129232 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4a9f0361-dc67-49fd-b3e1-c818534f9d57 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:46.129893 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4a9f0361-dc67-49fd-b3e1-c818534f9d57 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:46.130797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4a9f0361-dc67-49fd-b3e1-c818534f9d57 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:46.131239 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4a9f0361-dc67-49fd-b3e1-c818534f9d57 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:46.263446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cbefedfc-bccf-4062-a3ee-4b4a270775eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:46.264120 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cbefedfc-bccf-4062-a3ee-4b4a270775eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:46.270753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cbefedfc-bccf-4062-a3ee-4b4a270775eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:46.271198 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cbefedfc-bccf-4062-a3ee-4b4a270775eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:46.271969 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cbefedfc-bccf-4062-a3ee-4b4a270775eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:46.272411 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cbefedfc-bccf-4062-a3ee-4b4a270775eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:46.275934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4a9f0361-dc67-49fd-b3e1-c818534f9d57 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:46.284363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4a9f0361-dc67-49fd-b3e1-c818534f9d57 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.166002 Jul 18 16:52:46.284956 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 167/317] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:46 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:46.331604 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:46.408954 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cbefedfc-bccf-4062-a3ee-4b4a270775eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:46.416510 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cbefedfc-bccf-4062-a3ee-4b4a270775eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.156904 Jul 18 16:52:46.417118 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 151/318] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:46 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:47.303284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-056e5673-465d-4fd6-b159-83040a2aecaa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:47.303926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-056e5673-465d-4fd6-b159-83040a2aecaa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:47.305991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:47.310813 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-056e5673-465d-4fd6-b159-83040a2aecaa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:47.311262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-056e5673-465d-4fd6-b159-83040a2aecaa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:47.312056 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-056e5673-465d-4fd6-b159-83040a2aecaa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:47.312500 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-056e5673-465d-4fd6-b159-83040a2aecaa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:47.434553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-22b8635c-3634-44c9-8927-0893e0fbac9f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:47.435386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-22b8635c-3634-44c9-8927-0893e0fbac9f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:47.442610 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-22b8635c-3634-44c9-8927-0893e0fbac9f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:47.444454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-22b8635c-3634-44c9-8927-0893e0fbac9f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:47.444454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-22b8635c-3634-44c9-8927-0893e0fbac9f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:47.444454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-22b8635c-3634-44c9-8927-0893e0fbac9f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:47.456561 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-056e5673-465d-4fd6-b159-83040a2aecaa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:47.464758 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-056e5673-465d-4fd6-b159-83040a2aecaa tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.165827 Jul 18 16:52:47.465584 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 168/319] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:47 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:47.580431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-22b8635c-3634-44c9-8927-0893e0fbac9f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:47.588241 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-22b8635c-3634-44c9-8927-0893e0fbac9f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.157629 Jul 18 16:52:47.593331 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 152/320] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:47 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:48.481843 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4953dcc2-ef3d-4dc8-9a36-baf429366d79 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:48.482809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4953dcc2-ef3d-4dc8-9a36-baf429366d79 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:48.489130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4953dcc2-ef3d-4dc8-9a36-baf429366d79 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:48.489584 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4953dcc2-ef3d-4dc8-9a36-baf429366d79 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:48.490349 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4953dcc2-ef3d-4dc8-9a36-baf429366d79 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:48.490780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4953dcc2-ef3d-4dc8-9a36-baf429366d79 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:48.605721 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d718dbf2-cbbf-4c39-962b-e52142e962eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:48.606338 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d718dbf2-cbbf-4c39-962b-e52142e962eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:48.608293 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=8 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:48.614597 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d718dbf2-cbbf-4c39-962b-e52142e962eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:48.615451 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d718dbf2-cbbf-4c39-962b-e52142e962eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:48.615822 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d718dbf2-cbbf-4c39-962b-e52142e962eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:48.616250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d718dbf2-cbbf-4c39-962b-e52142e962eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:48.625753 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4953dcc2-ef3d-4dc8-9a36-baf429366d79 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:48.637622 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4953dcc2-ef3d-4dc8-9a36-baf429366d79 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.159380 Jul 18 16:52:48.638581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 169/321] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:48 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:48.645417 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:48.768294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d718dbf2-cbbf-4c39-962b-e52142e962eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:48.776039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d718dbf2-cbbf-4c39-962b-e52142e962eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.174368 Jul 18 16:52:48.776609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 153/322] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:48 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:49.663365 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b078a8c1-b58d-4eb4-9151-f6f69cc239a2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:49.663906 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b078a8c1-b58d-4eb4-9151-f6f69cc239a2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:49.669884 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b078a8c1-b58d-4eb4-9151-f6f69cc239a2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:49.670337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b078a8c1-b58d-4eb4-9151-f6f69cc239a2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:49.671129 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b078a8c1-b58d-4eb4-9151-f6f69cc239a2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:49.671569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b078a8c1-b58d-4eb4-9151-f6f69cc239a2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:49.818135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-42426fdd-6c68-4166-931c-b916054e4ed5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:49.818872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-42426fdd-6c68-4166-931c-b916054e4ed5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:49.819503 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b078a8c1-b58d-4eb4-9151-f6f69cc239a2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:49.833544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42426fdd-6c68-4166-931c-b916054e4ed5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:49.833774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b078a8c1-b58d-4eb4-9151-f6f69cc239a2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.167795 Jul 18 16:52:49.833861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42426fdd-6c68-4166-931c-b916054e4ed5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:49.833861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42426fdd-6c68-4166-931c-b916054e4ed5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:49.833861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42426fdd-6c68-4166-931c-b916054e4ed5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:49.834078 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 170/323] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:49 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:49.971974 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-42426fdd-6c68-4166-931c-b916054e4ed5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:49.979766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-42426fdd-6c68-4166-931c-b916054e4ed5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.186916 Jul 18 16:52:49.980339 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 154/324] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:49 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:50.847643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-97200c19-3b60-4204-9ac7-904973355a25 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:50.849599 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-97200c19-3b60-4204-9ac7-904973355a25 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:50.854133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97200c19-3b60-4204-9ac7-904973355a25 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:50.854579 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97200c19-3b60-4204-9ac7-904973355a25 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:50.855339 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97200c19-3b60-4204-9ac7-904973355a25 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:50.855773 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97200c19-3b60-4204-9ac7-904973355a25 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:50.998566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cdca3f85-5d15-4f78-8db4-d1f61fa5ff45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:50.999243 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cdca3f85-5d15-4f78-8db4-d1f61fa5ff45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:51.002311 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-97200c19-3b60-4204-9ac7-904973355a25 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:51.006616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cdca3f85-5d15-4f78-8db4-d1f61fa5ff45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:51.007284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cdca3f85-5d15-4f78-8db4-d1f61fa5ff45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:51.008053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cdca3f85-5d15-4f78-8db4-d1f61fa5ff45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:51.008483 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cdca3f85-5d15-4f78-8db4-d1f61fa5ff45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:51.011190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-97200c19-3b60-4204-9ac7-904973355a25 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.167288 Jul 18 16:52:51.011756 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 171/325] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:50 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:51.143704 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cdca3f85-5d15-4f78-8db4-d1f61fa5ff45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:51.151197 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cdca3f85-5d15-4f78-8db4-d1f61fa5ff45 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.157297 Jul 18 16:52:51.151779 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 155/326] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:50 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:52.034363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-89f2b00c-49bc-4022-93e2-840eba44ba6c tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:52.034363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-89f2b00c-49bc-4022-93e2-840eba44ba6c tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:52.037229 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-89f2b00c-49bc-4022-93e2-840eba44ba6c tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:52.037679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-89f2b00c-49bc-4022-93e2-840eba44ba6c tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:52.038466 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-89f2b00c-49bc-4022-93e2-840eba44ba6c tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:52.038928 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-89f2b00c-49bc-4022-93e2-840eba44ba6c tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:52.168548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-65656744-87a1-4616-8937-bf826c869310 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:52.169314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-65656744-87a1-4616-8937-bf826c869310 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:52.170532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-89f2b00c-49bc-4022-93e2-840eba44ba6c tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:52.176112 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-65656744-87a1-4616-8937-bf826c869310 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:52.176595 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-65656744-87a1-4616-8937-bf826c869310 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:52.177396 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-65656744-87a1-4616-8937-bf826c869310 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:52.177829 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-65656744-87a1-4616-8937-bf826c869310 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:52.178149 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-89f2b00c-49bc-4022-93e2-840eba44ba6c tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.152659 Jul 18 16:52:52.178779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 172/327] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:52 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:52.311063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-65656744-87a1-4616-8937-bf826c869310 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:52.318245 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-65656744-87a1-4616-8937-bf826c869310 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.154263 Jul 18 16:52:52.318811 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 156/328] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:52 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:53.195153 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-34af949e-afdc-4c05-ab5d-068f33c8dde5 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:53.195734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-34af949e-afdc-4c05-ab5d-068f33c8dde5 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:53.202140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-34af949e-afdc-4c05-ab5d-068f33c8dde5 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.202583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-34af949e-afdc-4c05-ab5d-068f33c8dde5 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.203361 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-34af949e-afdc-4c05-ab5d-068f33c8dde5 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.204288 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-34af949e-afdc-4c05-ab5d-068f33c8dde5 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.336039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-eec505bd-5cf3-4915-8560-460f44e046cf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:53.336750 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-eec505bd-5cf3-4915-8560-460f44e046cf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:53.342879 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-34af949e-afdc-4c05-ab5d-068f33c8dde5 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:53.346973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eec505bd-5cf3-4915-8560-460f44e046cf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.347423 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eec505bd-5cf3-4915-8560-460f44e046cf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.348197 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eec505bd-5cf3-4915-8560-460f44e046cf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.348628 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-eec505bd-5cf3-4915-8560-460f44e046cf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.350825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-34af949e-afdc-4c05-ab5d-068f33c8dde5 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.159663 Jul 18 16:52:53.351409 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 173/329] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:53 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:53.485969 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-eec505bd-5cf3-4915-8560-460f44e046cf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:53.493544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-eec505bd-5cf3-4915-8560-460f44e046cf tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1502 microversion: 2.1 time: 0.161759 Jul 18 16:52:53.494108 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 157/330] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:53 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:53.510587 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0381edf-9ea9-4158-b97e-1c26fc87d936"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:53.511743 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:53.518440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.518891 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.519675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.520122 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.537605 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:53.544492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] HTTP exception thrown: Cannot 'attach_volume' instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 while it is in vm_state rescued Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Request method failure captured: Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: POST /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10/os-volume_attachments HTTP/1.1 Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 74 Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y9CIuTubgqM74W1_pbe5k_tS6w9g7u9d3gDr9ZZ8_vU18vhSPDw4nQcs-sVbcs5CF14wI4yvButN1_qeoJe8XiWbIdGlymLgi-J1tlXq7Xbpn2ppklDf0u5U6c4ygl78ZQGY7WJNvxgE-ikmjSI_UwxizhN8rPrNBLY8DvlKOhUiOE Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:52:53.546366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6299ea3e56e84d3cbd2e8f74ef62510e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}] Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: f2d1f86034b94e289bb1fc754f02f4ac Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {"volumeAttachment": {"volumeId": "a0381edf-9ea9-4158-b97e-1c26fc87d936"}} Jul 18 16:52:53.548388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Cannot 'attach_volume' instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 while it is in vm_state rescued Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'server_id': '9b0acf48-1262-4cbc-98dc-562510f2cc10', 'body': {'volumeAttachment': {'volumeId': 'a0381edf-9ea9-4158-b97e-1c26fc87d936'}}} Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:52:53.549494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 while it is in vm_state rescued Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:52:53.550714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:52:53.551837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:52:53.551837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:52:53.551837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 while it is in vm_state rescued Jul 18 16:52:53.551837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:52:53.551837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Returning 409 to user: Cannot 'attach_volume' instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 while it is in vm_state rescued {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:52:53.551837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-786eeb35-b416-4636-b129-e0bd38a1fe0b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041742 Jul 18 16:52:53.551837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 174/331] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:52:53 2022] POST /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:52:53.557682 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-97e15f32-3f89-4579-a3ea-5f8723deb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:53.558125 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-97e15f32-3f89-4579-a3ea-5f8723deb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:53.564981 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-97e15f32-3f89-4579-a3ea-5f8723deb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.565375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-97e15f32-3f89-4579-a3ea-5f8723deb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.566145 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-97e15f32-3f89-4579-a3ea-5f8723deb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.566582 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-97e15f32-3f89-4579-a3ea-5f8723deb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.769734 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-97e15f32-3f89-4579-a3ea-5f8723deb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10/action" status: 202 len: 0 microversion: 2.1 time: 0.215684 Jul 18 16:52:53.770610 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 158/332] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:52:53 2022] POST /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:52:53.779337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3216b3ed-943b-4403-8330-bd2a1db7e4fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:53.780099 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3216b3ed-943b-4403-8330-bd2a1db7e4fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:53.786866 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3216b3ed-943b-4403-8330-bd2a1db7e4fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.787319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3216b3ed-943b-4403-8330-bd2a1db7e4fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.788091 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3216b3ed-943b-4403-8330-bd2a1db7e4fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.788527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3216b3ed-943b-4403-8330-bd2a1db7e4fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.942984 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3216b3ed-943b-4403-8330-bd2a1db7e4fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:53.956187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3216b3ed-943b-4403-8330-bd2a1db7e4fe tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1510 microversion: 2.1 time: 0.180249 Jul 18 16:52:53.957175 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 175/333] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:53 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:54.368070 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1294101f-ccb1-49c9-8351-c0b145a8527e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:54.371666 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1294101f-ccb1-49c9-8351-c0b145a8527e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:54.375827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1294101f-ccb1-49c9-8351-c0b145a8527e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.376281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1294101f-ccb1-49c9-8351-c0b145a8527e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.377094 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1294101f-ccb1-49c9-8351-c0b145a8527e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.377576 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1294101f-ccb1-49c9-8351-c0b145a8527e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.606465 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1294101f-ccb1-49c9-8351-c0b145a8527e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:54.617316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1294101f-ccb1-49c9-8351-c0b145a8527e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.253850 Jul 18 16:52:54.619385 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 159/334] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:54 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:54.973787 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-99418237-bcec-4bd0-9797-5625bd7afc0f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:54.974397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-99418237-bcec-4bd0-9797-5625bd7afc0f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:54.980463 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-99418237-bcec-4bd0-9797-5625bd7afc0f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.980950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-99418237-bcec-4bd0-9797-5625bd7afc0f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.981713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-99418237-bcec-4bd0-9797-5625bd7afc0f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.982155 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-99418237-bcec-4bd0-9797-5625bd7afc0f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:55.133454 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-99418237-bcec-4bd0-9797-5625bd7afc0f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:55.142817 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-99418237-bcec-4bd0-9797-5625bd7afc0f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1510 microversion: 2.1 time: 0.173470 Jul 18 16:52:55.143933 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 176/335] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:54 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:55.634924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d2813331-5ec0-4d8a-bb94-abd49b765956 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:55.635540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d2813331-5ec0-4d8a-bb94-abd49b765956 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:55.642171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d2813331-5ec0-4d8a-bb94-abd49b765956 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:55.642623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d2813331-5ec0-4d8a-bb94-abd49b765956 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:55.643431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d2813331-5ec0-4d8a-bb94-abd49b765956 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:55.643870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d2813331-5ec0-4d8a-bb94-abd49b765956 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:55.790267 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d2813331-5ec0-4d8a-bb94-abd49b765956 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:55.800665 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d2813331-5ec0-4d8a-bb94-abd49b765956 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.169807 Jul 18 16:52:55.802066 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 160/336] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:55 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:56.160385 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d87319c1-5110-41de-bf80-e6c4abcaa608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:56.161114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d87319c1-5110-41de-bf80-e6c4abcaa608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:56.168404 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d87319c1-5110-41de-bf80-e6c4abcaa608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:56.169407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d87319c1-5110-41de-bf80-e6c4abcaa608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.170460 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d87319c1-5110-41de-bf80-e6c4abcaa608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:56.170648 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d87319c1-5110-41de-bf80-e6c4abcaa608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.186375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-65aa1152-dff8-4a1f-9ae7-6444aa28813f req-6cd04629-3945-4deb-8932-2ab36f868b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5983e4e-fd93-4b05-b152-8c5c488364f6", "name": "network-vif-plugged", "status": "completed", "tag": "1e587242-bec2-4c2e-ae22-9a164230f521"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:52:56.195718 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-65aa1152-dff8-4a1f-9ae7-6444aa28813f req-6cd04629-3945-4deb-8932-2ab36f868b0b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:56.196380 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-65aa1152-dff8-4a1f-9ae7-6444aa28813f req-6cd04629-3945-4deb-8932-2ab36f868b0b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.209540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-65aa1152-dff8-4a1f-9ae7-6444aa28813f req-6cd04629-3945-4deb-8932-2ab36f868b0b service nova] Creating event network-vif-plugged:1e587242-bec2-4c2e-ae22-9a164230f521 for instance f5983e4e-fd93-4b05-b152-8c5c488364f6 on hv-cinder-84617 Jul 18 16:52:56.214537 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-65aa1152-dff8-4a1f-9ae7-6444aa28813f req-6cd04629-3945-4deb-8932-2ab36f868b0b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032893 Jul 18 16:52:56.215227 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 161/337] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:52:56.314656 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d87319c1-5110-41de-bf80-e6c4abcaa608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:56.322550 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d87319c1-5110-41de-bf80-e6c4abcaa608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1510 microversion: 2.1 time: 0.166723 Jul 18 16:52:56.323227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 177/338] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:56 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:56.819688 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fc730819-3c99-4489-b5d7-df201419ff47 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:56.820388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fc730819-3c99-4489-b5d7-df201419ff47 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:56.826622 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fc730819-3c99-4489-b5d7-df201419ff47 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:56.827075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fc730819-3c99-4489-b5d7-df201419ff47 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.827843 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fc730819-3c99-4489-b5d7-df201419ff47 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:56.828281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fc730819-3c99-4489-b5d7-df201419ff47 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.980039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-fc730819-3c99-4489-b5d7-df201419ff47 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:56.987944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fc730819-3c99-4489-b5d7-df201419ff47 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.173010 Jul 18 16:52:56.988861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 162/339] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:56 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:57.340441 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-34884f3e-a5ba-44a1-9785-b97497853797 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:57.342007 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-34884f3e-a5ba-44a1-9785-b97497853797 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:57.354287 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-34884f3e-a5ba-44a1-9785-b97497853797 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:57.354287 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-34884f3e-a5ba-44a1-9785-b97497853797 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:57.354287 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-34884f3e-a5ba-44a1-9785-b97497853797 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:57.354287 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-34884f3e-a5ba-44a1-9785-b97497853797 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:57.507510 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-34884f3e-a5ba-44a1-9785-b97497853797 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:57.515164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-34884f3e-a5ba-44a1-9785-b97497853797 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1516 microversion: 2.1 time: 0.178732 Jul 18 16:52:57.517026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 178/340] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:57 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:58.005843 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a89ecac9-2a00-4d39-82fe-d16e7ed1e963 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:58.006571 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a89ecac9-2a00-4d39-82fe-d16e7ed1e963 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:58.013536 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a89ecac9-2a00-4d39-82fe-d16e7ed1e963 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:58.013986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a89ecac9-2a00-4d39-82fe-d16e7ed1e963 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:58.014797 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a89ecac9-2a00-4d39-82fe-d16e7ed1e963 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:58.015228 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a89ecac9-2a00-4d39-82fe-d16e7ed1e963 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:58.161284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a89ecac9-2a00-4d39-82fe-d16e7ed1e963 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:58.170960 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a89ecac9-2a00-4d39-82fe-d16e7ed1e963 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1261 microversion: 2.1 time: 0.168583 Jul 18 16:52:58.171871 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 163/341] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:57 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:59.189230 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-71e9a459-7eed-4de5-b4eb-27557e51c06f tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:59.190199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-71e9a459-7eed-4de5-b4eb-27557e51c06f tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:59.197273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-71e9a459-7eed-4de5-b4eb-27557e51c06f tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:59.198137 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-71e9a459-7eed-4de5-b4eb-27557e51c06f tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:59.199113 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-71e9a459-7eed-4de5-b4eb-27557e51c06f tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:59.199901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-71e9a459-7eed-4de5-b4eb-27557e51c06f tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:59.336943 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-71e9a459-7eed-4de5-b4eb-27557e51c06f tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:59.345409 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-71e9a459-7eed-4de5-b4eb-27557e51c06f tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1446 microversion: 2.1 time: 0.161078 Jul 18 16:52:59.350833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 179/342] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:59 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:59.362390 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ed102ba2-8d6e-4315-9792-0077fa73a71d tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:59.363011 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ed102ba2-8d6e-4315-9792-0077fa73a71d tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:59.370014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ed102ba2-8d6e-4315-9792-0077fa73a71d tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:59.370582 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ed102ba2-8d6e-4315-9792-0077fa73a71d tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:59.371389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ed102ba2-8d6e-4315-9792-0077fa73a71d tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:59.371815 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ed102ba2-8d6e-4315-9792-0077fa73a71d tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:59.510679 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ed102ba2-8d6e-4315-9792-0077fa73a71d tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:59.518279 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ed102ba2-8d6e-4315-9792-0077fa73a71d tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1446 microversion: 2.1 time: 0.160267 Jul 18 16:52:59.518846 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 164/343] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:59 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:00.282960 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f0e90532-eda7-4833-a757-3e3ff9b63772 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'create', calling method: .version_select at 0x7fd4f5d4c280>, body: {"keypair": {"name": "tempest-keypair-45966551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT/lirQoHrs9B00o9o5EpwCV/ok6reHvxcOQW05YQjsVQKX1dIWDNvg9zOqh7OjcUKYexoLr81aPYU1G8fWbrAW187XkkpuzXaXxHxATT6fudPAjSba9b1EvueK4jsh6g=="}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:00.298347 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-f0e90532-eda7-4833-a757-3e3ff9b63772 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Getting quotas for project 6299ea3e56e84d3cbd2e8f74ef62510e. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:53:00.302573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-f0e90532-eda7-4833-a757-3e3ff9b63772 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Getting quotas for user f2d1f86034b94e289bb1fc754f02f4ac and project 6299ea3e56e84d3cbd2e8f74ef62510e. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:00.409254 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f0e90532-eda7-4833-a757-3e3ff9b63772 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.130083 Jul 18 16:53:00.409859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 180/344] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:53:00 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:02.395706 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-60a1a383-fadb-4788-ab2f-7be7401f0dce req-347a9c0d-42bd-4d26-9070-4aa8c29622ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5983e4e-fd93-4b05-b152-8c5c488364f6", "tag": "1e587242-bec2-4c2e-ae22-9a164230f521"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:02.418479 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-60a1a383-fadb-4788-ab2f-7be7401f0dce req-347a9c0d-42bd-4d26-9070-4aa8c29622ca service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:02.418924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-60a1a383-fadb-4788-ab2f-7be7401f0dce req-347a9c0d-42bd-4d26-9070-4aa8c29622ca service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:02.452913 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-60a1a383-fadb-4788-ab2f-7be7401f0dce req-347a9c0d-42bd-4d26-9070-4aa8c29622ca service nova] Creating event network-changed:1e587242-bec2-4c2e-ae22-9a164230f521 for instance f5983e4e-fd93-4b05-b152-8c5c488364f6 on hv-cinder-84617 Jul 18 16:53:02.460247 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-60a1a383-fadb-4788-ab2f-7be7401f0dce req-347a9c0d-42bd-4d26-9070-4aa8c29622ca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067797 Jul 18 16:53:02.462355 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 165/345] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:03.760815 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1227692474", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30fcea63-502f-43e4-90e7-89703318f070"}], "security_groups": [{"name": "tempest-securitygroup--740936361"}], "key_name": "tempest-keypair-45966551", "user_data": "}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:03.877407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] validate_networks() for [('30fcea63-502f-43e4-90e7-89703318f070', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:53:04.288608 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:53:04.289159 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:53:04.289610 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:53:04.290015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:53:04.290425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:53:04.299335 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:04.299871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:04.300965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:04.301369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:04.319524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Getting quotas for project 6299ea3e56e84d3cbd2e8f74ef62510e. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:53:04.327965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Getting quotas for user f2d1f86034b94e289bb1fc754f02f4ac and project 6299ea3e56e84d3cbd2e8f74ef62510e. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:04.341060 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:53:04.343682 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:53:04.497871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-313526a3-07e2-4d05-bf09-27a310b52ed3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.741562 Jul 18 16:53:04.499144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 181/346] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:53:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:53:04.510556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-247d26f4-1c19-4643-a26a-3fd2ff46fd68 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:04.511171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-247d26f4-1c19-4643-a26a-3fd2ff46fd68 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:04.582989 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-247d26f4-1c19-4643-a26a-3fd2ff46fd68 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:04.599345 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-247d26f4-1c19-4643-a26a-3fd2ff46fd68 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1244 microversion: 2.1 time: 0.093340 Jul 18 16:53:04.614651 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 166/347] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:04 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:05.622275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9818965d-1401-4621-afbb-68e0ac81e918 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:05.623528 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9818965d-1401-4621-afbb-68e0ac81e918 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:05.630680 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9818965d-1401-4621-afbb-68e0ac81e918 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:05.631353 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9818965d-1401-4621-afbb-68e0ac81e918 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:05.632299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9818965d-1401-4621-afbb-68e0ac81e918 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:05.632914 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9818965d-1401-4621-afbb-68e0ac81e918 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:05.699688 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9818965d-1401-4621-afbb-68e0ac81e918 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:05.707938 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9818965d-1401-4621-afbb-68e0ac81e918 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1248 microversion: 2.1 time: 0.089316 Jul 18 16:53:05.712736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 182/348] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:05 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:06.727872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2b88e40f-9b73-4ca1-bc54-b04826c24be7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:06.728420 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2b88e40f-9b73-4ca1-bc54-b04826c24be7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:06.735610 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2b88e40f-9b73-4ca1-bc54-b04826c24be7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:06.736051 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2b88e40f-9b73-4ca1-bc54-b04826c24be7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:06.736823 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2b88e40f-9b73-4ca1-bc54-b04826c24be7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:06.737262 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2b88e40f-9b73-4ca1-bc54-b04826c24be7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:06.798726 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2b88e40f-9b73-4ca1-bc54-b04826c24be7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:06.806099 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2b88e40f-9b73-4ca1-bc54-b04826c24be7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1248 microversion: 2.1 time: 0.082285 Jul 18 16:53:06.806653 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 167/349] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:06 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:07.822914 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-de743074-e67a-4751-ad76-fce606319fea tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:07.823590 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-de743074-e67a-4751-ad76-fce606319fea tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:07.830117 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-de743074-e67a-4751-ad76-fce606319fea tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.830569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-de743074-e67a-4751-ad76-fce606319fea tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.831356 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-de743074-e67a-4751-ad76-fce606319fea tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.831828 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-de743074-e67a-4751-ad76-fce606319fea tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.894036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-de743074-e67a-4751-ad76-fce606319fea tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:07.901743 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-de743074-e67a-4751-ad76-fce606319fea tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1296 microversion: 2.1 time: 0.082763 Jul 18 16:53:07.902319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 183/350] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:07 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:08.565155 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1330889345", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "networks": [{"uuid": "28c3a16e-a4d5-4be8-99b2-9dc17a6f5299"}]}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:08.619164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] validate_networks() for [('28c3a16e-a4d5-4be8-99b2-9dc17a6f5299', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:53:08.919300 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1f9b955a-c139-4bf3-9178-9f1def55d843 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:08.919913 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1f9b955a-c139-4bf3-9178-9f1def55d843 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:08.926094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1f9b955a-c139-4bf3-9178-9f1def55d843 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.926543 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1f9b955a-c139-4bf3-9178-9f1def55d843 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.927549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1f9b955a-c139-4bf3-9178-9f1def55d843 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.929758 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1f9b955a-c139-4bf3-9178-9f1def55d843 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.998125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1f9b955a-c139-4bf3-9178-9f1def55d843 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:09.008329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1f9b955a-c139-4bf3-9178-9f1def55d843 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1304 microversion: 2.1 time: 0.092975 Jul 18 16:53:09.009112 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 184/351] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:08 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:09.440331 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:53:09.440763 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:53:09.441271 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:53:09.441854 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:53:09.442265 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:53:09.452046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.452498 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.453587 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.454024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.472775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Getting quotas for project 4fe102d227ea4f60bdf22c20cd028341. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:53:09.477132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Getting quotas for user 81d0641fc86a43f7a6c772add1e2ae48 and project 4fe102d227ea4f60bdf22c20cd028341. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:09.491207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:53:09.493587 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:53:09.674861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-bf73c061-74f7-42bb-932b-cbd4f09098a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114033 Jul 18 16:53:09.687546 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a066f35c-5d00-4774-aa14-c33cd62a82b4 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:09.688191 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a066f35c-5d00-4774-aa14-c33cd62a82b4 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:09.691319 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 168/352] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:53:09.761412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a066f35c-5d00-4774-aa14-c33cd62a82b4 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:09.769207 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a066f35c-5d00-4774-aa14-c33cd62a82b4 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1219 microversion: 2.1 time: 0.086459 Jul 18 16:53:09.773357 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 185/353] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:09 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:10.032914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-25ef2eb5-a65a-4b28-9ac2-bd5fc60e8a3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:10.033695 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-25ef2eb5-a65a-4b28-9ac2-bd5fc60e8a3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:10.041638 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-25ef2eb5-a65a-4b28-9ac2-bd5fc60e8a3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.042090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-25ef2eb5-a65a-4b28-9ac2-bd5fc60e8a3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.042876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-25ef2eb5-a65a-4b28-9ac2-bd5fc60e8a3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.043284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-25ef2eb5-a65a-4b28-9ac2-bd5fc60e8a3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.268576 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-25ef2eb5-a65a-4b28-9ac2-bd5fc60e8a3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:10.276365 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-25ef2eb5-a65a-4b28-9ac2-bd5fc60e8a3c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.248728 Jul 18 16:53:10.277138 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 169/354] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:10 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:10.787018 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ef60035d-fd38-4129-bb95-048e4a64e889 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:10.788777 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ef60035d-fd38-4129-bb95-048e4a64e889 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:10.796308 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef60035d-fd38-4129-bb95-048e4a64e889 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.797784 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef60035d-fd38-4129-bb95-048e4a64e889 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.801914 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef60035d-fd38-4129-bb95-048e4a64e889 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.802458 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef60035d-fd38-4129-bb95-048e4a64e889 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.880017 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ef60035d-fd38-4129-bb95-048e4a64e889 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:10.889474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ef60035d-fd38-4129-bb95-048e4a64e889 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1223 microversion: 2.1 time: 0.106555 Jul 18 16:53:10.890190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 186/355] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:10 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:11.022163 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-a9c37cd6-d214-42ec-82b9-8ddb20c7d3d5 req-1f5b6e56-14b7-49da-b072-0aaa8fcd5ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3504a1-341a-4a72-9cd1-0597e63ffa7d", "tag": "b2759155-87eb-4bd6-b4ea-81f112800de2"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:11.048174 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-a9c37cd6-d214-42ec-82b9-8ddb20c7d3d5 req-1f5b6e56-14b7-49da-b072-0aaa8fcd5ed7 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.048980 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-a9c37cd6-d214-42ec-82b9-8ddb20c7d3d5 req-1f5b6e56-14b7-49da-b072-0aaa8fcd5ed7 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.061398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-a9c37cd6-d214-42ec-82b9-8ddb20c7d3d5 req-1f5b6e56-14b7-49da-b072-0aaa8fcd5ed7 service nova] Creating event network-changed:b2759155-87eb-4bd6-b4ea-81f112800de2 for instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d on hv-cinder-84617 Jul 18 16:53:11.071813 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-a9c37cd6-d214-42ec-82b9-8ddb20c7d3d5 req-1f5b6e56-14b7-49da-b072-0aaa8fcd5ed7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053056 Jul 18 16:53:11.072432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 170/356] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:11.294224 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ba3b469b-01f3-4b39-b828-6c5ff0e74919 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:11.295114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ba3b469b-01f3-4b39-b828-6c5ff0e74919 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:11.297406 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:11.302824 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ba3b469b-01f3-4b39-b828-6c5ff0e74919 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.303477 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ba3b469b-01f3-4b39-b828-6c5ff0e74919 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.304168 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ba3b469b-01f3-4b39-b828-6c5ff0e74919 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.304603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ba3b469b-01f3-4b39-b828-6c5ff0e74919 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.446977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ba3b469b-01f3-4b39-b828-6c5ff0e74919 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:11.455734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ba3b469b-01f3-4b39-b828-6c5ff0e74919 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.165624 Jul 18 16:53:11.456604 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 187/357] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:11 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:11.907092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f84c3854-d1ca-4c89-a5f0-ef732329ee6d tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:11.907692 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f84c3854-d1ca-4c89-a5f0-ef732329ee6d tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:11.914240 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f84c3854-d1ca-4c89-a5f0-ef732329ee6d tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.914687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f84c3854-d1ca-4c89-a5f0-ef732329ee6d tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:11.915461 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f84c3854-d1ca-4c89-a5f0-ef732329ee6d tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:11.915902 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f84c3854-d1ca-4c89-a5f0-ef732329ee6d tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.015324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f84c3854-d1ca-4c89-a5f0-ef732329ee6d tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:12.023302 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f84c3854-d1ca-4c89-a5f0-ef732329ee6d tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1271 microversion: 2.1 time: 0.120829 Jul 18 16:53:12.024196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 171/358] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:11 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:12.473980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-47e43a74-edee-41b1-836a-6912207f764a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:12.474690 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-47e43a74-edee-41b1-836a-6912207f764a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:12.480831 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-47e43a74-edee-41b1-836a-6912207f764a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.481301 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-47e43a74-edee-41b1-836a-6912207f764a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.482058 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-47e43a74-edee-41b1-836a-6912207f764a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.482489 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-47e43a74-edee-41b1-836a-6912207f764a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.630049 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-47e43a74-edee-41b1-836a-6912207f764a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:12.638271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-47e43a74-edee-41b1-836a-6912207f764a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.168156 Jul 18 16:53:12.639140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 188/359] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:12 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:13.046702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-424bd784-a189-493a-8ba1-6465aa335874 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:13.047300 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-424bd784-a189-493a-8ba1-6465aa335874 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:13.055146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-424bd784-a189-493a-8ba1-6465aa335874 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.055690 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-424bd784-a189-493a-8ba1-6465aa335874 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.060492 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-424bd784-a189-493a-8ba1-6465aa335874 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.060492 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-424bd784-a189-493a-8ba1-6465aa335874 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.195824 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-424bd784-a189-493a-8ba1-6465aa335874 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:13.199568 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.204632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-424bd784-a189-493a-8ba1-6465aa335874 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.161899 Jul 18 16:53:13.205248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 172/360] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:13 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:13.655897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6a1e9b11-b731-4b02-b678-08a15ac7e45e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:13.656526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6a1e9b11-b731-4b02-b678-08a15ac7e45e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:13.663308 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6a1e9b11-b731-4b02-b678-08a15ac7e45e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.663785 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6a1e9b11-b731-4b02-b678-08a15ac7e45e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.664560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6a1e9b11-b731-4b02-b678-08a15ac7e45e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.665037 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6a1e9b11-b731-4b02-b678-08a15ac7e45e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.806306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6a1e9b11-b731-4b02-b678-08a15ac7e45e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:13.814610 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6a1e9b11-b731-4b02-b678-08a15ac7e45e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.162944 Jul 18 16:53:13.815179 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 189/361] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:13 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:14.143875 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-19730848-6814-4f95-92aa-9192372da0db req-c8a56d20-473b-4e1e-8490-61fa96681ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1579d2b5-2f69-4482-a945-a0484d56671c", "tag": "283c8fe9-257c-432d-b922-6a40eb30d5b0"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:14.154602 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.157818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-19730848-6814-4f95-92aa-9192372da0db req-c8a56d20-473b-4e1e-8490-61fa96681ddd service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.158257 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-19730848-6814-4f95-92aa-9192372da0db req-c8a56d20-473b-4e1e-8490-61fa96681ddd service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.180210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-19730848-6814-4f95-92aa-9192372da0db req-c8a56d20-473b-4e1e-8490-61fa96681ddd service nova] Creating event network-changed:283c8fe9-257c-432d-b922-6a40eb30d5b0 for instance 1579d2b5-2f69-4482-a945-a0484d56671c on hv-cinder-84617 Jul 18 16:53:14.185095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-19730848-6814-4f95-92aa-9192372da0db req-c8a56d20-473b-4e1e-8490-61fa96681ddd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045506 Jul 18 16:53:14.185895 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 173/362] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:14.222482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bde65756-bc50-4462-a3ba-be884589b408 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:14.223012 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bde65756-bc50-4462-a3ba-be884589b408 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:14.229266 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bde65756-bc50-4462-a3ba-be884589b408 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.229705 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bde65756-bc50-4462-a3ba-be884589b408 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.230481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bde65756-bc50-4462-a3ba-be884589b408 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.230955 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bde65756-bc50-4462-a3ba-be884589b408 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.307425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.414436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-bde65756-bc50-4462-a3ba-be884589b408 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:14.421906 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bde65756-bc50-4462-a3ba-be884589b408 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.203317 Jul 18 16:53:14.423146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 190/363] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:14 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:14.832230 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-53aafb57-c54c-4cff-9370-da8f541fc79f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:14.833205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-53aafb57-c54c-4cff-9370-da8f541fc79f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:14.841218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53aafb57-c54c-4cff-9370-da8f541fc79f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.841665 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53aafb57-c54c-4cff-9370-da8f541fc79f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.842435 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53aafb57-c54c-4cff-9370-da8f541fc79f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.843513 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53aafb57-c54c-4cff-9370-da8f541fc79f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.073815 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-53aafb57-c54c-4cff-9370-da8f541fc79f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:15.082870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-53aafb57-c54c-4cff-9370-da8f541fc79f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.254496 Jul 18 16:53:15.083552 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 174/364] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:14 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:15.440572 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f0624c25-8490-443d-b741-f5a3a4b59ca0 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:15.440572 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f0624c25-8490-443d-b741-f5a3a4b59ca0 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:15.447621 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0624c25-8490-443d-b741-f5a3a4b59ca0 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.448292 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0624c25-8490-443d-b741-f5a3a4b59ca0 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.449589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0624c25-8490-443d-b741-f5a3a4b59ca0 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.450723 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0624c25-8490-443d-b741-f5a3a4b59ca0 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.591762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f0624c25-8490-443d-b741-f5a3a4b59ca0 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:15.600236 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f0624c25-8490-443d-b741-f5a3a4b59ca0 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.165292 Jul 18 16:53:15.601131 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 191/365] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:15 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:16.105547 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a4197c66-11b7-46c9-8164-6a82d22545f9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:16.106159 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a4197c66-11b7-46c9-8164-6a82d22545f9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:16.114292 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a4197c66-11b7-46c9-8164-6a82d22545f9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.115133 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a4197c66-11b7-46c9-8164-6a82d22545f9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.115966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a4197c66-11b7-46c9-8164-6a82d22545f9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.116374 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a4197c66-11b7-46c9-8164-6a82d22545f9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.266744 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a4197c66-11b7-46c9-8164-6a82d22545f9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:16.276990 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a4197c66-11b7-46c9-8164-6a82d22545f9 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.177581 Jul 18 16:53:16.277688 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 175/366] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:16 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:16.618048 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c9e6f7b8-debf-4602-989f-d50ba12c17c5 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:16.618663 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c9e6f7b8-debf-4602-989f-d50ba12c17c5 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:16.625976 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c9e6f7b8-debf-4602-989f-d50ba12c17c5 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.626429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c9e6f7b8-debf-4602-989f-d50ba12c17c5 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.627212 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c9e6f7b8-debf-4602-989f-d50ba12c17c5 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.627650 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c9e6f7b8-debf-4602-989f-d50ba12c17c5 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.779001 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c9e6f7b8-debf-4602-989f-d50ba12c17c5 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:16.789772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c9e6f7b8-debf-4602-989f-d50ba12c17c5 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.175455 Jul 18 16:53:16.790754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 192/367] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:16 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:17.294790 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4e4cbb68-1af9-43fe-ace0-655236b986eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:17.295453 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4e4cbb68-1af9-43fe-ace0-655236b986eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:17.302768 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e4cbb68-1af9-43fe-ace0-655236b986eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.303155 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e4cbb68-1af9-43fe-ace0-655236b986eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.303920 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e4cbb68-1af9-43fe-ace0-655236b986eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.304359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e4cbb68-1af9-43fe-ace0-655236b986eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.450567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4e4cbb68-1af9-43fe-ace0-655236b986eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:17.459424 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4e4cbb68-1af9-43fe-ace0-655236b986eb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.168800 Jul 18 16:53:17.460087 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 176/368] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:17 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:17.807461 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f33534ca-6999-407c-beec-9981ad8afc44 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:17.808071 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f33534ca-6999-407c-beec-9981ad8afc44 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:17.820843 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f33534ca-6999-407c-beec-9981ad8afc44 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.820843 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f33534ca-6999-407c-beec-9981ad8afc44 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.820843 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f33534ca-6999-407c-beec-9981ad8afc44 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:17.820843 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f33534ca-6999-407c-beec-9981ad8afc44 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.980721 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f33534ca-6999-407c-beec-9981ad8afc44 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:17.999051 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f33534ca-6999-407c-beec-9981ad8afc44 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.195617 Jul 18 16:53:18.002012 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 193/369] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:17 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:18.476304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b0272404-8ea2-41ac-be6a-7ac2727e55cb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:18.476799 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b0272404-8ea2-41ac-be6a-7ac2727e55cb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:18.484669 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b0272404-8ea2-41ac-be6a-7ac2727e55cb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.485141 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b0272404-8ea2-41ac-be6a-7ac2727e55cb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.485901 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b0272404-8ea2-41ac-be6a-7ac2727e55cb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.488558 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b0272404-8ea2-41ac-be6a-7ac2727e55cb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.520451 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-d5d23e60-d0d6-4c55-8436-d820c0837c2b req-4d406527-8a93-4c4f-bb78-f3982c7fb9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3504a1-341a-4a72-9cd1-0597e63ffa7d", "name": "network-vif-plugged", "status": "completed", "tag": "b2759155-87eb-4bd6-b4ea-81f112800de2"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:18.530203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-d5d23e60-d0d6-4c55-8436-d820c0837c2b req-4d406527-8a93-4c4f-bb78-f3982c7fb9e2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.531385 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-d5d23e60-d0d6-4c55-8436-d820c0837c2b req-4d406527-8a93-4c4f-bb78-f3982c7fb9e2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.555908 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:18.561164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-d5d23e60-d0d6-4c55-8436-d820c0837c2b req-4d406527-8a93-4c4f-bb78-f3982c7fb9e2 service nova] Creating event network-vif-plugged:b2759155-87eb-4bd6-b4ea-81f112800de2 for instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d on hv-cinder-84617 Jul 18 16:53:18.576283 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-d5d23e60-d0d6-4c55-8436-d820c0837c2b req-4d406527-8a93-4c4f-bb78-f3982c7fb9e2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059404 Jul 18 16:53:18.578033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 194/370] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:19.018942 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-716e3891-a49b-45f5-95e0-79802fdd21de tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:19.019823 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-716e3891-a49b-45f5-95e0-79802fdd21de tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:19.026950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-716e3891-a49b-45f5-95e0-79802fdd21de tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.027441 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-716e3891-a49b-45f5-95e0-79802fdd21de tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.028402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-716e3891-a49b-45f5-95e0-79802fdd21de tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.028845 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-716e3891-a49b-45f5-95e0-79802fdd21de tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.093235 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b0272404-8ea2-41ac-be6a-7ac2727e55cb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:19.102009 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b0272404-8ea2-41ac-be6a-7ac2727e55cb tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.629505 Jul 18 16:53:19.113624 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 177/371] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:18 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:19.197326 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-716e3891-a49b-45f5-95e0-79802fdd21de tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:19.207916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-716e3891-a49b-45f5-95e0-79802fdd21de tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.194083 Jul 18 16:53:19.217597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 195/372] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:19 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:20.123534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-34c14f31-e742-40ab-9d3b-e405a192dab1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:20.123534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-34c14f31-e742-40ab-9d3b-e405a192dab1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:20.128071 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:20.129204 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=8 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:20.130832 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-34c14f31-e742-40ab-9d3b-e405a192dab1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.131618 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-34c14f31-e742-40ab-9d3b-e405a192dab1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.132568 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-34c14f31-e742-40ab-9d3b-e405a192dab1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.133267 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-34c14f31-e742-40ab-9d3b-e405a192dab1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.225627 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c1d0ea5c-c36d-4b7a-a363-804be50bccfb tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:20.226524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c1d0ea5c-c36d-4b7a-a363-804be50bccfb tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:20.228829 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=12 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:20.234713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1d0ea5c-c36d-4b7a-a363-804be50bccfb tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.235245 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1d0ea5c-c36d-4b7a-a363-804be50bccfb tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.236268 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1d0ea5c-c36d-4b7a-a363-804be50bccfb tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.236918 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1d0ea5c-c36d-4b7a-a363-804be50bccfb tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.409390 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c1d0ea5c-c36d-4b7a-a363-804be50bccfb tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:20.417790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c1d0ea5c-c36d-4b7a-a363-804be50bccfb tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.196100 Jul 18 16:53:20.420178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 196/373] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:20 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:20.433717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-34c14f31-e742-40ab-9d3b-e405a192dab1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:20.443314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-34c14f31-e742-40ab-9d3b-e405a192dab1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1369 microversion: 2.1 time: 0.325642 Jul 18 16:53:20.455461 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 178/374] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:20 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1369 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:20.606936 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-623d501e-4b72-41bd-88f4-42362f77b656 req-c280fc7a-7d64-4345-839d-5ef123850a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1579d2b5-2f69-4482-a945-a0484d56671c", "name": "network-vif-plugged", "status": "completed", "tag": "283c8fe9-257c-432d-b922-6a40eb30d5b0"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:20.616379 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-623d501e-4b72-41bd-88f4-42362f77b656 req-c280fc7a-7d64-4345-839d-5ef123850a01 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.617061 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-623d501e-4b72-41bd-88f4-42362f77b656 req-c280fc7a-7d64-4345-839d-5ef123850a01 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.629252 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-623d501e-4b72-41bd-88f4-42362f77b656 req-c280fc7a-7d64-4345-839d-5ef123850a01 service nova] Creating event network-vif-plugged:283c8fe9-257c-432d-b922-6a40eb30d5b0 for instance 1579d2b5-2f69-4482-a945-a0484d56671c on hv-cinder-84617 Jul 18 16:53:20.634356 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-623d501e-4b72-41bd-88f4-42362f77b656 req-c280fc7a-7d64-4345-839d-5ef123850a01 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031988 Jul 18 16:53:20.635130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 197/375] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:21.439008 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b98446a3-ad15-4ab1-8246-0ead2260e1d9 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:21.443102 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b98446a3-ad15-4ab1-8246-0ead2260e1d9 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:21.450808 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b98446a3-ad15-4ab1-8246-0ead2260e1d9 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.451255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b98446a3-ad15-4ab1-8246-0ead2260e1d9 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.452245 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b98446a3-ad15-4ab1-8246-0ead2260e1d9 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.453316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b98446a3-ad15-4ab1-8246-0ead2260e1d9 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.465807 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d3ffe49e-242d-4f92-8d2e-d995460faeda tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:21.467409 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d3ffe49e-242d-4f92-8d2e-d995460faeda tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:21.475508 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d3ffe49e-242d-4f92-8d2e-d995460faeda tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.476338 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d3ffe49e-242d-4f92-8d2e-d995460faeda tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.477280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d3ffe49e-242d-4f92-8d2e-d995460faeda tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.477991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d3ffe49e-242d-4f92-8d2e-d995460faeda tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.647628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d3ffe49e-242d-4f92-8d2e-d995460faeda tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:21.656427 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d3ffe49e-242d-4f92-8d2e-d995460faeda tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1564 microversion: 2.1 time: 0.194896 Jul 18 16:53:21.657053 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 198/376] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:21 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1564 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:21.694925 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7acd3af0-f4cf-47e6-81c7-87ef68a0f52b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:21.695492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7acd3af0-f4cf-47e6-81c7-87ef68a0f52b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:21.701905 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7acd3af0-f4cf-47e6-81c7-87ef68a0f52b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.705132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7acd3af0-f4cf-47e6-81c7-87ef68a0f52b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.705132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7acd3af0-f4cf-47e6-81c7-87ef68a0f52b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.705132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7acd3af0-f4cf-47e6-81c7-87ef68a0f52b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.706922 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b98446a3-ad15-4ab1-8246-0ead2260e1d9 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:21.715475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b98446a3-ad15-4ab1-8246-0ead2260e1d9 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.280998 Jul 18 16:53:21.716227 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 179/377] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:21 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:21.787174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7acd3af0-f4cf-47e6-81c7-87ef68a0f52b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096001 Jul 18 16:53:21.787987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 199/378] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 16:53:21 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:22.734607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0956a732-8fa4-4ee9-a55d-99c98c1eec95 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:22.736077 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0956a732-8fa4-4ee9-a55d-99c98c1eec95 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:22.744962 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0956a732-8fa4-4ee9-a55d-99c98c1eec95 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.745844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0956a732-8fa4-4ee9-a55d-99c98c1eec95 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.747058 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0956a732-8fa4-4ee9-a55d-99c98c1eec95 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.747657 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0956a732-8fa4-4ee9-a55d-99c98c1eec95 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.987237 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0956a732-8fa4-4ee9-a55d-99c98c1eec95 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:22.995391 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0956a732-8fa4-4ee9-a55d-99c98c1eec95 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1319 microversion: 2.1 time: 0.265826 Jul 18 16:53:22.995982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 180/379] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:22 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:23.280492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-f5091e73-ef24-47aa-8cd0-860ee9e71689 req-45828d1d-e5ee-484a-9499-5e79dece09d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3504a1-341a-4a72-9cd1-0597e63ffa7d", "tag": "b2759155-87eb-4bd6-b4ea-81f112800de2"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:23.290352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-f5091e73-ef24-47aa-8cd0-860ee9e71689 req-45828d1d-e5ee-484a-9499-5e79dece09d7 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:23.290799 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-f5091e73-ef24-47aa-8cd0-860ee9e71689 req-45828d1d-e5ee-484a-9499-5e79dece09d7 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:23.304934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-f5091e73-ef24-47aa-8cd0-860ee9e71689 req-45828d1d-e5ee-484a-9499-5e79dece09d7 service nova] Creating event network-changed:b2759155-87eb-4bd6-b4ea-81f112800de2 for instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d on hv-cinder-84617 Jul 18 16:53:23.310806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-f5091e73-ef24-47aa-8cd0-860ee9e71689 req-45828d1d-e5ee-484a-9499-5e79dece09d7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036154 Jul 18 16:53:23.312577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 200/380] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:24.011720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7c3f099b-13b2-4d7d-94c6-4e3800a57990 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:24.012470 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7c3f099b-13b2-4d7d-94c6-4e3800a57990 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:24.019695 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7c3f099b-13b2-4d7d-94c6-4e3800a57990 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:24.020153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7c3f099b-13b2-4d7d-94c6-4e3800a57990 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.020959 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7c3f099b-13b2-4d7d-94c6-4e3800a57990 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:24.021406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7c3f099b-13b2-4d7d-94c6-4e3800a57990 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.384403 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7c3f099b-13b2-4d7d-94c6-4e3800a57990 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:24.394210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7c3f099b-13b2-4d7d-94c6-4e3800a57990 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1509 microversion: 2.1 time: 0.386258 Jul 18 16:53:24.408589 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 181/381] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:24 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:33.628161 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:53:33.628929 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 16:53:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:53:34.485983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-de6d52d6-28ae-47dc-bee4-199a944391e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:34.487219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-de6d52d6-28ae-47dc-bee4-199a944391e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:34.490153 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=27 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:34.492238 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=26 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:34.515597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-de6d52d6-28ae-47dc-bee4-199a944391e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:34.516516 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-de6d52d6-28ae-47dc-bee4-199a944391e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:34.519657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-de6d52d6-28ae-47dc-bee4-199a944391e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:34.519657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-de6d52d6-28ae-47dc-bee4-199a944391e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:34.773372 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-de6d52d6-28ae-47dc-bee4-199a944391e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lazy-loading 'services' on Instance uuid e67187e3-9b84-4393-a7bf-c15db8b715ee {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:53:35.096420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-de6d52d6-28ae-47dc-bee4-199a944391e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/os-volume_attachments/c17db7c2-93ef-4218-b0ae-891311e8ac87" status: 202 len: 0 microversion: 2.1 time: 0.616414 Jul 18 16:53:35.106272 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 201/382] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:53:34 2022] DELETE /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/os-volume_attachments/c17db7c2-93ef-4218-b0ae-891311e8ac87 => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:53:37.340633 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-60c0747c-7666-49a5-be25-fdca8b6bcd36 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:37.346825 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=17 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:37.347503 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=50 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:37.349452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-60c0747c-7666-49a5-be25-fdca8b6bcd36 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.350343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-60c0747c-7666-49a5-be25-fdca8b6bcd36 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.406892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-60c0747c-7666-49a5-be25-fdca8b6bcd36 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Going to try to stop instance {{(pid=124754) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 16:53:37.629544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-60c0747c-7666-49a5-be25-fdca8b6bcd36 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/action" status: 202 len: 0 microversion: 2.1 time: 0.293532 Jul 18 16:53:37.630906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 182/383] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:53:37 2022] POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:53:37.640104 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-dd800f81-68e9-4391-80ff-2b5c8872304b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:37.641624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-dd800f81-68e9-4391-80ff-2b5c8872304b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:37.648924 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dd800f81-68e9-4391-80ff-2b5c8872304b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.649755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dd800f81-68e9-4391-80ff-2b5c8872304b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.650791 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dd800f81-68e9-4391-80ff-2b5c8872304b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.651503 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dd800f81-68e9-4391-80ff-2b5c8872304b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.831285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-dd800f81-68e9-4391-80ff-2b5c8872304b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:37.844038 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-dd800f81-68e9-4391-80ff-2b5c8872304b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.208318 Jul 18 16:53:37.855277 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 202/384] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:37 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:38.863046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-75970717-8f80-4699-929d-6fc9d8ed5154 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:38.863793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-75970717-8f80-4699-929d-6fc9d8ed5154 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:38.870249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75970717-8f80-4699-929d-6fc9d8ed5154 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:38.870714 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75970717-8f80-4699-929d-6fc9d8ed5154 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:38.871519 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75970717-8f80-4699-929d-6fc9d8ed5154 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:38.871903 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75970717-8f80-4699-929d-6fc9d8ed5154 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:39.037208 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-75970717-8f80-4699-929d-6fc9d8ed5154 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:39.045882 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-75970717-8f80-4699-929d-6fc9d8ed5154 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.187098 Jul 18 16:53:39.046691 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 183/385] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:38 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:40.065666 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ce6c111c-5e6d-499e-a463-259d9ae620c5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:40.067538 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ce6c111c-5e6d-499e-a463-259d9ae620c5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:40.075374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ce6c111c-5e6d-499e-a463-259d9ae620c5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.082470 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ce6c111c-5e6d-499e-a463-259d9ae620c5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.082470 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ce6c111c-5e6d-499e-a463-259d9ae620c5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.082470 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ce6c111c-5e6d-499e-a463-259d9ae620c5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.226179 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ce6c111c-5e6d-499e-a463-259d9ae620c5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:40.236570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ce6c111c-5e6d-499e-a463-259d9ae620c5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.175753 Jul 18 16:53:40.241882 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 203/386] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:40 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:41.254531 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-88c63cff-fcb8-464e-ae14-44b7c6b47d55 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:41.255185 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-88c63cff-fcb8-464e-ae14-44b7c6b47d55 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:41.261698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-88c63cff-fcb8-464e-ae14-44b7c6b47d55 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.262445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-88c63cff-fcb8-464e-ae14-44b7c6b47d55 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.264417 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-88c63cff-fcb8-464e-ae14-44b7c6b47d55 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:41.266102 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-88c63cff-fcb8-464e-ae14-44b7c6b47d55 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.431097 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-88c63cff-fcb8-464e-ae14-44b7c6b47d55 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:41.445549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-88c63cff-fcb8-464e-ae14-44b7c6b47d55 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.192003 Jul 18 16:53:41.446195 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 184/387] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:41 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:42.465558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f90e5717-d903-414e-b1f0-a63d378f3b10 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:42.466207 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f90e5717-d903-414e-b1f0-a63d378f3b10 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:42.486759 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f90e5717-d903-414e-b1f0-a63d378f3b10 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.491980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f90e5717-d903-414e-b1f0-a63d378f3b10 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.491980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f90e5717-d903-414e-b1f0-a63d378f3b10 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.491980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f90e5717-d903-414e-b1f0-a63d378f3b10 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.679508 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f90e5717-d903-414e-b1f0-a63d378f3b10 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:42.690821 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f90e5717-d903-414e-b1f0-a63d378f3b10 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.229526 Jul 18 16:53:42.692185 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 204/388] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:42 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:43.434552 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-26aa4b9e-a7a7-41b2-b6f8-9378b916af08 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Action: 'create', calling method: .version_select at 0x7fd4f5518af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-481777633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRZXfHBkBB0RbcnLMCEf5kWHUoxVyGvis4LXVu3xl796RCfN6dHngUPnvnJdBUIqRKhLFh2d5/lQuNRBhrGZaq2ResbUA4SHXuM8DJJMA3ynFtd0wP3iaKihj6q7ZlQHw=="}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:43.449680 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-26aa4b9e-a7a7-41b2-b6f8-9378b916af08 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Getting quotas for project a0aa59ff7f5a460daa866b1f3e6dae1a. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:53:43.454085 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-26aa4b9e-a7a7-41b2-b6f8-9378b916af08 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Getting quotas for user ab4d3667826148d390eda90bb8baf081 and project a0aa59ff7f5a460daa866b1f3e6dae1a. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:43.544437 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-26aa4b9e-a7a7-41b2-b6f8-9378b916af08 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.113749 Jul 18 16:53:43.545577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 185/389] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:53:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:43.645915 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-880784a9-fd3b-42c5-8851-05d0f135de6a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54607dc9-72af-4d4e-a3fb-3fca4aa0558e", "device": "/dev/sdb"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:43.647576 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-880784a9-fd3b-42c5-8851-05d0f135de6a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:43.653595 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-880784a9-fd3b-42c5-8851-05d0f135de6a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:43.654051 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-880784a9-fd3b-42c5-8851-05d0f135de6a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:43.654824 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-880784a9-fd3b-42c5-8851-05d0f135de6a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:43.655265 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-880784a9-fd3b-42c5-8851-05d0f135de6a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:43.708225 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-914726889", "imageRef": "4c6d8fa9-fb6a-4791-91e7-210c4dd1e96f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-481777633", "networks": [{"uuid": "18c96ab6-a70c-455a-94a9-fea6000ff9f4"}]}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:43.763896 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] validate_networks() for [('18c96ab6-a70c-455a-94a9-fea6000ff9f4', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:53:44.150286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:53:44.150699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:53:44.151198 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:53:44.151611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:53:44.152014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:53:44.161160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.161612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.162410 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.162850 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.180703 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Getting quotas for project a0aa59ff7f5a460daa866b1f3e6dae1a. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:53:44.184650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Getting quotas for user ab4d3667826148d390eda90bb8baf081 and project a0aa59ff7f5a460daa866b1f3e6dae1a. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:53:44.196727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:53:44.199008 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c6d8fa9-fb6a-4791-91e7-210c4dd1e96f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:53:44.324962 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3c9ea48d-2aee-4326-93b3-a6f2ad991e19 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620939 Jul 18 16:53:44.325502 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 186/390] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 16:53:44.329951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a489f8ab-c5ef-4918-8b2d-e3fffa82182e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:44.330555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a489f8ab-c5ef-4918-8b2d-e3fffa82182e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:44.337820 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a489f8ab-c5ef-4918-8b2d-e3fffa82182e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.337820 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a489f8ab-c5ef-4918-8b2d-e3fffa82182e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.338542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a489f8ab-c5ef-4918-8b2d-e3fffa82182e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.339091 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a489f8ab-c5ef-4918-8b2d-e3fffa82182e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.494016 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a489f8ab-c5ef-4918-8b2d-e3fffa82182e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:44.504208 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a489f8ab-c5ef-4918-8b2d-e3fffa82182e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.177693 Jul 18 16:53:44.504909 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 187/391] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:44 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:44.509794 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-21fee630-6134-455b-b03e-83be6185e979 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:44.510612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-21fee630-6134-455b-b03e-83be6185e979 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:44.525539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-880784a9-fd3b-42c5-8851-05d0f135de6a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "POST /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883958 Jul 18 16:53:44.526389 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 205/392] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:53:43 2022] POST /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c/os-volume_attachments => generated 194 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:44.590169 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-21fee630-6134-455b-b03e-83be6185e979 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:44.597778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-21fee630-6134-455b-b03e-83be6185e979 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1257 microversion: 2.1 time: 0.091775 Jul 18 16:53:44.598638 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 188/393] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:44 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1257 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:45.523916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a2654699-1522-42e5-ae6a-0e664610dc0b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:45.524613 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a2654699-1522-42e5-ae6a-0e664610dc0b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:45.530950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2654699-1522-42e5-ae6a-0e664610dc0b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.536442 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2654699-1522-42e5-ae6a-0e664610dc0b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.536442 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2654699-1522-42e5-ae6a-0e664610dc0b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.536442 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2654699-1522-42e5-ae6a-0e664610dc0b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.616731 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2c58d41a-b55e-4be8-8725-9ec32bd8cf8a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:45.617963 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2c58d41a-b55e-4be8-8725-9ec32bd8cf8a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:45.625968 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2c58d41a-b55e-4be8-8725-9ec32bd8cf8a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.626471 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2c58d41a-b55e-4be8-8725-9ec32bd8cf8a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.627247 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2c58d41a-b55e-4be8-8725-9ec32bd8cf8a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.627683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2c58d41a-b55e-4be8-8725-9ec32bd8cf8a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.670866 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a2654699-1522-42e5-ae6a-0e664610dc0b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:45.679403 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a2654699-1522-42e5-ae6a-0e664610dc0b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.160348 Jul 18 16:53:45.680323 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 206/394] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:45 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:45.708281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2c58d41a-b55e-4be8-8725-9ec32bd8cf8a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:45.717157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2c58d41a-b55e-4be8-8725-9ec32bd8cf8a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1261 microversion: 2.1 time: 0.105389 Jul 18 16:53:45.717986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 189/395] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:45 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:46.697539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e19f2ea6-5b2d-43ee-a500-b1f05801c6fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:46.698149 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e19f2ea6-5b2d-43ee-a500-b1f05801c6fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:46.713748 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea6-5b2d-43ee-a500-b1f05801c6fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.713748 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea6-5b2d-43ee-a500-b1f05801c6fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.713748 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea6-5b2d-43ee-a500-b1f05801c6fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.713748 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea6-5b2d-43ee-a500-b1f05801c6fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.735922 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-582d75a6-1012-40b9-8ebf-6c44a65268e1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:46.736544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-582d75a6-1012-40b9-8ebf-6c44a65268e1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:46.743295 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-582d75a6-1012-40b9-8ebf-6c44a65268e1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.745248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-582d75a6-1012-40b9-8ebf-6c44a65268e1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.745248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-582d75a6-1012-40b9-8ebf-6c44a65268e1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.745248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-582d75a6-1012-40b9-8ebf-6c44a65268e1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.810263 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-582d75a6-1012-40b9-8ebf-6c44a65268e1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:46.818541 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-582d75a6-1012-40b9-8ebf-6c44a65268e1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1309 microversion: 2.1 time: 0.087119 Jul 18 16:53:46.819583 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 190/396] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:46 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1309 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:46.851456 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e19f2ea6-5b2d-43ee-a500-b1f05801c6fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:46.859020 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e19f2ea6-5b2d-43ee-a500-b1f05801c6fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.165267 Jul 18 16:53:46.859587 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 207/397] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:46 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:47.840607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9127feb5-4aaf-4008-8253-cd9373b2e44a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:47.840607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9127feb5-4aaf-4008-8253-cd9373b2e44a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:47.846801 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9127feb5-4aaf-4008-8253-cd9373b2e44a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.847321 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9127feb5-4aaf-4008-8253-cd9373b2e44a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.848118 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9127feb5-4aaf-4008-8253-cd9373b2e44a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.848558 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9127feb5-4aaf-4008-8253-cd9373b2e44a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.888028 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0a7f9fcb-6f3d-4f5b-92ae-4028bfa6ba46 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:47.889206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0a7f9fcb-6f3d-4f5b-92ae-4028bfa6ba46 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:47.898152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0a7f9fcb-6f3d-4f5b-92ae-4028bfa6ba46 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.898593 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0a7f9fcb-6f3d-4f5b-92ae-4028bfa6ba46 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.899555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0a7f9fcb-6f3d-4f5b-92ae-4028bfa6ba46 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:47.900185 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0a7f9fcb-6f3d-4f5b-92ae-4028bfa6ba46 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:48.066199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0a7f9fcb-6f3d-4f5b-92ae-4028bfa6ba46 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:48.074338 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0a7f9fcb-6f3d-4f5b-92ae-4028bfa6ba46 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1677 microversion: 2.1 time: 0.201844 Jul 18 16:53:48.074909 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 208/398] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:47 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:48.198390 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9127feb5-4aaf-4008-8253-cd9373b2e44a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:48.219037 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9127feb5-4aaf-4008-8253-cd9373b2e44a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.383943 Jul 18 16:53:48.219612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 191/399] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:47 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:48.951495 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-8451f195-ccf2-4dc7-bc99-c386eb3bc40b req-a84c25a6-4f07-4c2a-b061-b004808f195c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f88bfc-2675-40e9-a413-ab95f2b7ad36", "tag": "38643ba4-8900-42fa-86db-6a74e9ac1a2e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:48.978875 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-8451f195-ccf2-4dc7-bc99-c386eb3bc40b req-a84c25a6-4f07-4c2a-b061-b004808f195c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:48.980203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-8451f195-ccf2-4dc7-bc99-c386eb3bc40b req-a84c25a6-4f07-4c2a-b061-b004808f195c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:48.995249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-8451f195-ccf2-4dc7-bc99-c386eb3bc40b req-a84c25a6-4f07-4c2a-b061-b004808f195c service nova] Creating event network-changed:38643ba4-8900-42fa-86db-6a74e9ac1a2e for instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 on hv-cinder-84617 Jul 18 16:53:49.002101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-8451f195-ccf2-4dc7-bc99-c386eb3bc40b req-a84c25a6-4f07-4c2a-b061-b004808f195c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054739 Jul 18 16:53:49.003370 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 209/400] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:53:49.093506 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1ff67c5c-49cc-4c5e-b815-cec421c80049 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:49.095212 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1ff67c5c-49cc-4c5e-b815-cec421c80049 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:49.103362 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ff67c5c-49cc-4c5e-b815-cec421c80049 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.104081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ff67c5c-49cc-4c5e-b815-cec421c80049 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.104912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ff67c5c-49cc-4c5e-b815-cec421c80049 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.105351 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ff67c5c-49cc-4c5e-b815-cec421c80049 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.237466 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2d89698d-6ba6-4e87-a8d6-4cba2f72a923 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:49.238171 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2d89698d-6ba6-4e87-a8d6-4cba2f72a923 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:49.246749 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2d89698d-6ba6-4e87-a8d6-4cba2f72a923 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.247546 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2d89698d-6ba6-4e87-a8d6-4cba2f72a923 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.249967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2d89698d-6ba6-4e87-a8d6-4cba2f72a923 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.250614 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2d89698d-6ba6-4e87-a8d6-4cba2f72a923 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.277268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1ff67c5c-49cc-4c5e-b815-cec421c80049 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:49.287377 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1ff67c5c-49cc-4c5e-b815-cec421c80049 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1654 microversion: 2.1 time: 0.198966 Jul 18 16:53:49.289007 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 192/401] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:49 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1654 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:49.312477 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e6b66bdf-8029-4beb-a9c4-dfdf13177a8b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:53:49.321975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e6b66bdf-8029-4beb-a9c4-dfdf13177a8b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.322667 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e6b66bdf-8029-4beb-a9c4-dfdf13177a8b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.359741 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e6b66bdf-8029-4beb-a9c4-dfdf13177a8b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Going to try to start instance {{(pid=124754) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 16:53:49.433318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2d89698d-6ba6-4e87-a8d6-4cba2f72a923 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:49.441798 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2d89698d-6ba6-4e87-a8d6-4cba2f72a923 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.210189 Jul 18 16:53:49.443091 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 210/402] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:49 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:49.573058 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e6b66bdf-8029-4beb-a9c4-dfdf13177a8b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/action" status: 202 len: 0 microversion: 2.1 time: 0.264964 Jul 18 16:53:49.573845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 193/403] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:53:49 2022] POST /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:53:49.583033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-76a508f4-3963-44e8-86c3-355a420bc059 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:49.583704 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-76a508f4-3963-44e8-86c3-355a420bc059 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:49.590142 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-76a508f4-3963-44e8-86c3-355a420bc059 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.590595 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-76a508f4-3963-44e8-86c3-355a420bc059 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.591401 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-76a508f4-3963-44e8-86c3-355a420bc059 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.591841 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-76a508f4-3963-44e8-86c3-355a420bc059 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.738783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-76a508f4-3963-44e8-86c3-355a420bc059 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:49.746755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-76a508f4-3963-44e8-86c3-355a420bc059 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.168025 Jul 18 16:53:49.747338 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 211/404] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:49 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:50.463289 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ad874cd4-e018-4237-8f2b-b41abf53acdc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:50.463944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ad874cd4-e018-4237-8f2b-b41abf53acdc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.472194 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad874cd4-e018-4237-8f2b-b41abf53acdc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.472782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad874cd4-e018-4237-8f2b-b41abf53acdc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.473639 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad874cd4-e018-4237-8f2b-b41abf53acdc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.474035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad874cd4-e018-4237-8f2b-b41abf53acdc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.627887 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ad874cd4-e018-4237-8f2b-b41abf53acdc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:50.635899 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ad874cd4-e018-4237-8f2b-b41abf53acdc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.177317 Jul 18 16:53:50.636746 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 194/405] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:50 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:50.763759 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-73cd6155-11e9-4b4b-bd48-381439b33fda tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:50.764399 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-73cd6155-11e9-4b4b-bd48-381439b33fda tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.772043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-73cd6155-11e9-4b4b-bd48-381439b33fda tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.772043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-73cd6155-11e9-4b4b-bd48-381439b33fda tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.772825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-73cd6155-11e9-4b4b-bd48-381439b33fda tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.773334 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-73cd6155-11e9-4b4b-bd48-381439b33fda tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.980645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-73cd6155-11e9-4b4b-bd48-381439b33fda tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:50.980645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-73cd6155-11e9-4b4b-bd48-381439b33fda tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.209956 Jul 18 16:53:50.980645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 212/406] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:50 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:51.652902 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-453ce9a6-032e-47f6-9e5b-c81039aa08e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:51.653477 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-453ce9a6-032e-47f6-9e5b-c81039aa08e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:51.659920 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-453ce9a6-032e-47f6-9e5b-c81039aa08e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.660411 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-453ce9a6-032e-47f6-9e5b-c81039aa08e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.661283 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-453ce9a6-032e-47f6-9e5b-c81039aa08e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.661605 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-453ce9a6-032e-47f6-9e5b-c81039aa08e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.988130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-deab9360-51d4-4e01-94b0-63cf4d5635d8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:51.988748 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-deab9360-51d4-4e01-94b0-63cf4d5635d8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:51.995303 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-deab9360-51d4-4e01-94b0-63cf4d5635d8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.999140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-deab9360-51d4-4e01-94b0-63cf4d5635d8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.999140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-deab9360-51d4-4e01-94b0-63cf4d5635d8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.999140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-deab9360-51d4-4e01-94b0-63cf4d5635d8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:52.100390 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-453ce9a6-032e-47f6-9e5b-c81039aa08e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:52.109580 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-453ce9a6-032e-47f6-9e5b-c81039aa08e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.460515 Jul 18 16:53:52.117979 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 195/407] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:51 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:52.221330 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-deab9360-51d4-4e01-94b0-63cf4d5635d8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:52.230155 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-deab9360-51d4-4e01-94b0-63cf4d5635d8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.246545 Jul 18 16:53:52.233342 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 213/408] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:51 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:53.134548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f60d6c60-9b0f-4285-a0ae-b2fac2f3dc38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:53.135459 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f60d6c60-9b0f-4285-a0ae-b2fac2f3dc38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:53.157312 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f60d6c60-9b0f-4285-a0ae-b2fac2f3dc38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.157672 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f60d6c60-9b0f-4285-a0ae-b2fac2f3dc38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.158468 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f60d6c60-9b0f-4285-a0ae-b2fac2f3dc38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.158906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f60d6c60-9b0f-4285-a0ae-b2fac2f3dc38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.248120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8b8abec9-c1ac-4ed2-aeb6-15756d684283 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:53.250339 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8b8abec9-c1ac-4ed2-aeb6-15756d684283 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:53.263851 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8b8abec9-c1ac-4ed2-aeb6-15756d684283 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.268504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8b8abec9-c1ac-4ed2-aeb6-15756d684283 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.268504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8b8abec9-c1ac-4ed2-aeb6-15756d684283 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:53.268504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8b8abec9-c1ac-4ed2-aeb6-15756d684283 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.310934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f60d6c60-9b0f-4285-a0ae-b2fac2f3dc38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:53.320146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f60d6c60-9b0f-4285-a0ae-b2fac2f3dc38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.189484 Jul 18 16:53:53.320970 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 196/409] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:53 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:53.419213 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8b8abec9-c1ac-4ed2-aeb6-15756d684283 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:53.432790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8b8abec9-c1ac-4ed2-aeb6-15756d684283 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.189548 Jul 18 16:53:53.434128 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 214/410] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:53 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:54.337551 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cf5e08ed-fd8f-4484-b8ea-20a01d78c329 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:54.338314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cf5e08ed-fd8f-4484-b8ea-20a01d78c329 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:54.340830 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:54.345933 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cf5e08ed-fd8f-4484-b8ea-20a01d78c329 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.346383 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cf5e08ed-fd8f-4484-b8ea-20a01d78c329 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.347192 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cf5e08ed-fd8f-4484-b8ea-20a01d78c329 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.347631 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cf5e08ed-fd8f-4484-b8ea-20a01d78c329 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.451184 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9f260bf5-c2c3-41c3-9aac-2c8ea7aa1be0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:54.453231 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9f260bf5-c2c3-41c3-9aac-2c8ea7aa1be0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:54.470930 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9f260bf5-c2c3-41c3-9aac-2c8ea7aa1be0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.471868 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9f260bf5-c2c3-41c3-9aac-2c8ea7aa1be0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.472860 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9f260bf5-c2c3-41c3-9aac-2c8ea7aa1be0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.473474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9f260bf5-c2c3-41c3-9aac-2c8ea7aa1be0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.575463 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cf5e08ed-fd8f-4484-b8ea-20a01d78c329 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:54.592291 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cf5e08ed-fd8f-4484-b8ea-20a01d78c329 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.258480 Jul 18 16:53:54.593141 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 197/411] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:54 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:54.642239 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9f260bf5-c2c3-41c3-9aac-2c8ea7aa1be0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:54.651739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9f260bf5-c2c3-41c3-9aac-2c8ea7aa1be0 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.204973 Jul 18 16:53:54.652336 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 215/412] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:54 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:55.616841 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-12ff5d1a-06b1-49ba-83b8-5041a7beb7b6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:55.617823 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-12ff5d1a-06b1-49ba-83b8-5041a7beb7b6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:55.620105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=12 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:55.627164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-12ff5d1a-06b1-49ba-83b8-5041a7beb7b6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.628265 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-12ff5d1a-06b1-49ba-83b8-5041a7beb7b6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.630435 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-12ff5d1a-06b1-49ba-83b8-5041a7beb7b6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.641201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-12ff5d1a-06b1-49ba-83b8-5041a7beb7b6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.670666 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-17707809-8037-4f34-b658-6f1fad4e71c4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:55.672098 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-17707809-8037-4f34-b658-6f1fad4e71c4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:55.697860 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17707809-8037-4f34-b658-6f1fad4e71c4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.699230 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17707809-8037-4f34-b658-6f1fad4e71c4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.701339 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17707809-8037-4f34-b658-6f1fad4e71c4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.706645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17707809-8037-4f34-b658-6f1fad4e71c4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.718737 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:55.834047 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-12ff5d1a-06b1-49ba-83b8-5041a7beb7b6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:55.842242 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-12ff5d1a-06b1-49ba-83b8-5041a7beb7b6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.236379 Jul 18 16:53:55.843540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 198/413] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:55 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:55.892067 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-17707809-8037-4f34-b658-6f1fad4e71c4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:55.900116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-17707809-8037-4f34-b658-6f1fad4e71c4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.234648 Jul 18 16:53:55.900701 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 216/414] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:55 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:56.865375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e02719fe-1355-44e1-acd4-3da10d07de38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:56.865375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e02719fe-1355-44e1-acd4-3da10d07de38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:56.868516 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e02719fe-1355-44e1-acd4-3da10d07de38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.868999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e02719fe-1355-44e1-acd4-3da10d07de38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.870095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e02719fe-1355-44e1-acd4-3da10d07de38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.870566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e02719fe-1355-44e1-acd4-3da10d07de38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.876000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:56.919596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0c617226-fe6d-4bbb-a19e-b625755e429d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:56.921255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0c617226-fe6d-4bbb-a19e-b625755e429d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:56.928610 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0c617226-fe6d-4bbb-a19e-b625755e429d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.929444 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0c617226-fe6d-4bbb-a19e-b625755e429d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.930476 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0c617226-fe6d-4bbb-a19e-b625755e429d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.931098 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0c617226-fe6d-4bbb-a19e-b625755e429d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:57.028237 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e02719fe-1355-44e1-acd4-3da10d07de38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:57.036943 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e02719fe-1355-44e1-acd4-3da10d07de38 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.181043 Jul 18 16:53:57.037531 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 199/415] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:56 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:57.078159 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0c617226-fe6d-4bbb-a19e-b625755e429d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:57.085928 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0c617226-fe6d-4bbb-a19e-b625755e429d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.171510 Jul 18 16:53:57.086491 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 217/416] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:56 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:58.058697 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-95777f9e-429b-434a-8ab0-4aceea2d573b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:58.059304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-95777f9e-429b-434a-8ab0-4aceea2d573b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:58.067526 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-95777f9e-429b-434a-8ab0-4aceea2d573b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.067973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-95777f9e-429b-434a-8ab0-4aceea2d573b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.068930 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-95777f9e-429b-434a-8ab0-4aceea2d573b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.069355 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-95777f9e-429b-434a-8ab0-4aceea2d573b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.104619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e53fd495-f552-43e6-844b-ae810bcf4cfb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:58.107469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e53fd495-f552-43e6-844b-ae810bcf4cfb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:58.122998 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e53fd495-f552-43e6-844b-ae810bcf4cfb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.123458 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e53fd495-f552-43e6-844b-ae810bcf4cfb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.127768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e53fd495-f552-43e6-844b-ae810bcf4cfb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.129750 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e53fd495-f552-43e6-844b-ae810bcf4cfb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.240010 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-95777f9e-429b-434a-8ab0-4aceea2d573b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:58.247879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-95777f9e-429b-434a-8ab0-4aceea2d573b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.193503 Jul 18 16:53:58.248473 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 200/417] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:58 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:58.290766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e53fd495-f552-43e6-844b-ae810bcf4cfb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:58.298659 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e53fd495-f552-43e6-844b-ae810bcf4cfb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.198519 Jul 18 16:53:58.299344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 218/418] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:58 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:59.266420 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7ba70c54-1472-49c1-9027-93dd7f4b7638 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:59.267209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7ba70c54-1472-49c1-9027-93dd7f4b7638 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:59.274828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7ba70c54-1472-49c1-9027-93dd7f4b7638 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:59.275933 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7ba70c54-1472-49c1-9027-93dd7f4b7638 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.276686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7ba70c54-1472-49c1-9027-93dd7f4b7638 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:59.277312 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7ba70c54-1472-49c1-9027-93dd7f4b7638 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.316179 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-81b9969b-d6f4-4de5-ac33-98d4497d5503 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:59.317589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-81b9969b-d6f4-4de5-ac33-98d4497d5503 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:59.324780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-81b9969b-d6f4-4de5-ac33-98d4497d5503 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:59.326044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-81b9969b-d6f4-4de5-ac33-98d4497d5503 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.326044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-81b9969b-d6f4-4de5-ac33-98d4497d5503 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:59.326484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-81b9969b-d6f4-4de5-ac33-98d4497d5503 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.572139 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7ba70c54-1472-49c1-9027-93dd7f4b7638 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:59.585995 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7ba70c54-1472-49c1-9027-93dd7f4b7638 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.324293 Jul 18 16:53:59.587000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 201/419] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:59 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:59.788583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-81b9969b-d6f4-4de5-ac33-98d4497d5503 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:59.799369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-81b9969b-d6f4-4de5-ac33-98d4497d5503 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.487248 Jul 18 16:53:59.801390 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 219/420] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:59 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:00.602788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-452f4642-ba9c-4031-98a6-3c727d859630 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:00.604023 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-452f4642-ba9c-4031-98a6-3c727d859630 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:00.610915 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-452f4642-ba9c-4031-98a6-3c727d859630 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.611364 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-452f4642-ba9c-4031-98a6-3c727d859630 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.612465 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-452f4642-ba9c-4031-98a6-3c727d859630 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.613089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-452f4642-ba9c-4031-98a6-3c727d859630 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.766749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-452f4642-ba9c-4031-98a6-3c727d859630 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:00.775727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-452f4642-ba9c-4031-98a6-3c727d859630 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.176724 Jul 18 16:54:00.776314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 202/421] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:00 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:00.817836 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-da5e908b-f5c1-4249-99d2-44013edcb765 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:00.818568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-da5e908b-f5c1-4249-99d2-44013edcb765 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:00.826896 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-da5e908b-f5c1-4249-99d2-44013edcb765 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.827653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-da5e908b-f5c1-4249-99d2-44013edcb765 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.828454 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-da5e908b-f5c1-4249-99d2-44013edcb765 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.828929 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-da5e908b-f5c1-4249-99d2-44013edcb765 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.068474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-da5e908b-f5c1-4249-99d2-44013edcb765 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:01.077792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-da5e908b-f5c1-4249-99d2-44013edcb765 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.263299 Jul 18 16:54:01.088394 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 220/422] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:00 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:01.795088 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5addb944-8b8f-4203-9dc5-de761e69d92c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:01.795925 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5addb944-8b8f-4203-9dc5-de761e69d92c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:01.803502 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5addb944-8b8f-4203-9dc5-de761e69d92c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.804089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5addb944-8b8f-4203-9dc5-de761e69d92c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.805291 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5addb944-8b8f-4203-9dc5-de761e69d92c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.806378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5addb944-8b8f-4203-9dc5-de761e69d92c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.958081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5addb944-8b8f-4203-9dc5-de761e69d92c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:01.966241 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5addb944-8b8f-4203-9dc5-de761e69d92c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.177026 Jul 18 16:54:01.966802 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 203/423] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:01 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:02.095764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-be46b56c-03a3-4266-b576-d1d989798553 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:02.096522 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-be46b56c-03a3-4266-b576-d1d989798553 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:02.109822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-be46b56c-03a3-4266-b576-d1d989798553 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.110884 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-be46b56c-03a3-4266-b576-d1d989798553 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.112355 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-be46b56c-03a3-4266-b576-d1d989798553 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.112797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-be46b56c-03a3-4266-b576-d1d989798553 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.343621 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-be46b56c-03a3-4266-b576-d1d989798553 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:02.351858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-be46b56c-03a3-4266-b576-d1d989798553 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.259936 Jul 18 16:54:02.371397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 221/424] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:02 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:02.982745 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2f709441-4377-4751-a031-888d52be9a1c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:02.983349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2f709441-4377-4751-a031-888d52be9a1c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:02.990648 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f709441-4377-4751-a031-888d52be9a1c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.991102 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f709441-4377-4751-a031-888d52be9a1c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.991882 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f709441-4377-4751-a031-888d52be9a1c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.992328 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f709441-4377-4751-a031-888d52be9a1c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.123259 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2f709441-4377-4751-a031-888d52be9a1c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:03.130814 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2f709441-4377-4751-a031-888d52be9a1c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.151827 Jul 18 16:54:03.131386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 204/425] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:02 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:03.370925 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3d5604b5-2c71-402b-90e5-9ecad7222bf3 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:03.370925 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3d5604b5-2c71-402b-90e5-9ecad7222bf3 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:03.377535 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3d5604b5-2c71-402b-90e5-9ecad7222bf3 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.377941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3d5604b5-2c71-402b-90e5-9ecad7222bf3 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.379047 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3d5604b5-2c71-402b-90e5-9ecad7222bf3 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.379650 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3d5604b5-2c71-402b-90e5-9ecad7222bf3 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.535654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3d5604b5-2c71-402b-90e5-9ecad7222bf3 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:03.544046 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3d5604b5-2c71-402b-90e5-9ecad7222bf3 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.178532 Jul 18 16:54:03.545534 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 222/426] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:03 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:04.147875 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c4cf9d24-8ba8-42d2-aede-3ef15318560f tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:04.148662 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c4cf9d24-8ba8-42d2-aede-3ef15318560f tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:04.155335 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c4cf9d24-8ba8-42d2-aede-3ef15318560f tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.155788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c4cf9d24-8ba8-42d2-aede-3ef15318560f tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.160919 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c4cf9d24-8ba8-42d2-aede-3ef15318560f tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.161425 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c4cf9d24-8ba8-42d2-aede-3ef15318560f tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.404201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c4cf9d24-8ba8-42d2-aede-3ef15318560f tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:04.412539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c4cf9d24-8ba8-42d2-aede-3ef15318560f tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.268486 Jul 18 16:54:04.414641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 205/427] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:04 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:04.563313 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-af885bd9-555b-4eda-bb59-3471cc81f0d1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:04.564016 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-af885bd9-555b-4eda-bb59-3471cc81f0d1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:04.570906 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-af885bd9-555b-4eda-bb59-3471cc81f0d1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.571416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-af885bd9-555b-4eda-bb59-3471cc81f0d1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.572187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-af885bd9-555b-4eda-bb59-3471cc81f0d1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.572622 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-af885bd9-555b-4eda-bb59-3471cc81f0d1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.726068 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-af885bd9-555b-4eda-bb59-3471cc81f0d1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:04.736102 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-af885bd9-555b-4eda-bb59-3471cc81f0d1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1663 microversion: 2.1 time: 0.177433 Jul 18 16:54:04.743002 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 223/428] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:04 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1663 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:05.431146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6e2823d0-957a-40b1-bb77-270124212c7c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:05.432463 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6e2823d0-957a-40b1-bb77-270124212c7c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:05.443545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6e2823d0-957a-40b1-bb77-270124212c7c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:05.446335 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6e2823d0-957a-40b1-bb77-270124212c7c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.452456 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6e2823d0-957a-40b1-bb77-270124212c7c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:05.453207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6e2823d0-957a-40b1-bb77-270124212c7c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.701363 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6e2823d0-957a-40b1-bb77-270124212c7c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:05.711881 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6e2823d0-957a-40b1-bb77-270124212c7c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.284141 Jul 18 16:54:05.713788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 206/429] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:05 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:05.759027 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-61f83934-e8c3-4a5b-af8a-828af4533acb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:05.760302 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-61f83934-e8c3-4a5b-af8a-828af4533acb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:05.762999 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=47 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:05.768053 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-61f83934-e8c3-4a5b-af8a-828af4533acb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:05.768715 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-61f83934-e8c3-4a5b-af8a-828af4533acb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.769717 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-61f83934-e8c3-4a5b-af8a-828af4533acb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:05.770304 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-61f83934-e8c3-4a5b-af8a-828af4533acb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.310337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-61f83934-e8c3-4a5b-af8a-828af4533acb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:06.318819 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-61f83934-e8c3-4a5b-af8a-828af4533acb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1667 microversion: 2.1 time: 0.563730 Jul 18 16:54:06.319409 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 224/430] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:05 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1667 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:06.734247 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0c691001-3539-4f17-88d8-e9453f4198d9 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:06.734862 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0c691001-3539-4f17-88d8-e9453f4198d9 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:06.744357 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0c691001-3539-4f17-88d8-e9453f4198d9 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.745115 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0c691001-3539-4f17-88d8-e9453f4198d9 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.746895 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0c691001-3539-4f17-88d8-e9453f4198d9 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.747719 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0c691001-3539-4f17-88d8-e9453f4198d9 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.899904 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0c691001-3539-4f17-88d8-e9453f4198d9 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:06.907811 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0c691001-3539-4f17-88d8-e9453f4198d9 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.178028 Jul 18 16:54:06.908386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 207/431] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:06 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:07.927284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2e9bcfc4-f342-4510-9979-477ae18798e4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:07.929210 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2e9bcfc4-f342-4510-9979-477ae18798e4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:07.937809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2e9bcfc4-f342-4510-9979-477ae18798e4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:07.938416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2e9bcfc4-f342-4510-9979-477ae18798e4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:07.940175 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2e9bcfc4-f342-4510-9979-477ae18798e4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:07.940837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2e9bcfc4-f342-4510-9979-477ae18798e4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:08.111927 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-541042bd-a9a7-4727-820b-05d8b24cffe8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1672945-d502-4d41-b9ce-85a02e9880bc"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:08.113331 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-541042bd-a9a7-4727-820b-05d8b24cffe8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:08.118050 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:08.124373 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-541042bd-a9a7-4727-820b-05d8b24cffe8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:08.126842 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-541042bd-a9a7-4727-820b-05d8b24cffe8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:08.127713 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-541042bd-a9a7-4727-820b-05d8b24cffe8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:08.128450 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-541042bd-a9a7-4727-820b-05d8b24cffe8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:08.159359 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2e9bcfc4-f342-4510-9979-477ae18798e4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:08.174319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2e9bcfc4-f342-4510-9979-477ae18798e4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.252834 Jul 18 16:54:08.175207 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 225/432] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:07 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:09.192763 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-27a46496-6dec-4378-8723-d811dd80c3f3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:09.193410 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-27a46496-6dec-4378-8723-d811dd80c3f3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:09.205502 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-27a46496-6dec-4378-8723-d811dd80c3f3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:09.205502 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-27a46496-6dec-4378-8723-d811dd80c3f3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:09.207719 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-27a46496-6dec-4378-8723-d811dd80c3f3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:09.208180 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-27a46496-6dec-4378-8723-d811dd80c3f3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:09.421787 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-27a46496-6dec-4378-8723-d811dd80c3f3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:09.432518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-27a46496-6dec-4378-8723-d811dd80c3f3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.244497 Jul 18 16:54:09.451540 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 226/433] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:09 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:09.576307 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-541042bd-a9a7-4727-820b-05d8b24cffe8 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.469730 Jul 18 16:54:09.578184 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 208/434] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:54:08 2022] POST /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments => generated 194 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:54:09.980618 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6aa3285f-63c5-4d1a-a4d5-9c81b534494d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Action: 'create', calling method: .version_select at 0x7fd4f522b820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-328566045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqTuBRBK/NKnVu8sc6YSJfwA2Rx/gxa2DqS5hZpFWg6FHV7wdkMxZNMQKUzgsysdNacKBPkaIhMuxoVFoeP/gv1QwrR3ub/ww77fZ/tgiXRkAvxmKNfkDIrBGVs3NBT8w=="}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:09.995206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-6aa3285f-63c5-4d1a-a4d5-9c81b534494d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Getting quotas for project 5d68154d9fdb40f0848b676c1fed6a50. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:54:09.999408 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-6aa3285f-63c5-4d1a-a4d5-9c81b534494d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Getting quotas for user cd69c5111dac492a9177128317f0962a and project 5d68154d9fdb40f0848b676c1fed6a50. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:54:10.084269 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6aa3285f-63c5-4d1a-a4d5-9c81b534494d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.344850 Jul 18 16:54:10.085235 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 227/435] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:54:09 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:10.451935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-665b1d3b-42d6-456e-8082-9ad905be1787 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:10.452654 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-665b1d3b-42d6-456e-8082-9ad905be1787 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:10.459794 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-665b1d3b-42d6-456e-8082-9ad905be1787 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:10.460247 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-665b1d3b-42d6-456e-8082-9ad905be1787 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:10.461258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-665b1d3b-42d6-456e-8082-9ad905be1787 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:10.461879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-665b1d3b-42d6-456e-8082-9ad905be1787 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:10.606083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-665b1d3b-42d6-456e-8082-9ad905be1787 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:10.614143 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-665b1d3b-42d6-456e-8082-9ad905be1787 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.167909 Jul 18 16:54:10.614737 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 209/436] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:10 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:11.631816 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bdeb7172-e68a-46e0-a3fb-54bd639858f6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:11.632514 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bdeb7172-e68a-46e0-a3fb-54bd639858f6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:11.640164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bdeb7172-e68a-46e0-a3fb-54bd639858f6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:11.640683 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bdeb7172-e68a-46e0-a3fb-54bd639858f6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:11.641579 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bdeb7172-e68a-46e0-a3fb-54bd639858f6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:11.642205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bdeb7172-e68a-46e0-a3fb-54bd639858f6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:11.801070 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-bdeb7172-e68a-46e0-a3fb-54bd639858f6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:11.812346 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bdeb7172-e68a-46e0-a3fb-54bd639858f6 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.184963 Jul 18 16:54:11.812952 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 228/437] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:11 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:12.843484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c74ee65b-39d3-4996-b6ee-ecd38c0028a3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:12.843484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c74ee65b-39d3-4996-b6ee-ecd38c0028a3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:12.843484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c74ee65b-39d3-4996-b6ee-ecd38c0028a3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.843484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c74ee65b-39d3-4996-b6ee-ecd38c0028a3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.844591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c74ee65b-39d3-4996-b6ee-ecd38c0028a3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.844591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c74ee65b-39d3-4996-b6ee-ecd38c0028a3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.992334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c74ee65b-39d3-4996-b6ee-ecd38c0028a3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:13.000759 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c74ee65b-39d3-4996-b6ee-ecd38c0028a3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.175482 Jul 18 16:54:13.001371 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 210/438] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:12 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:13.520477 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-1cba82c3-7236-4d3f-b690-121112c70efe req-91843f64-d27a-4fd8-8640-4de33643d3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f88bfc-2675-40e9-a413-ab95f2b7ad36", "name": "network-vif-plugged", "status": "completed", "tag": "38643ba4-8900-42fa-86db-6a74e9ac1a2e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:13.533978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-1cba82c3-7236-4d3f-b690-121112c70efe req-91843f64-d27a-4fd8-8640-4de33643d3ca service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:13.534648 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-1cba82c3-7236-4d3f-b690-121112c70efe req-91843f64-d27a-4fd8-8640-4de33643d3ca service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:13.548130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-1cba82c3-7236-4d3f-b690-121112c70efe req-91843f64-d27a-4fd8-8640-4de33643d3ca service nova] Creating event network-vif-plugged:38643ba4-8900-42fa-86db-6a74e9ac1a2e for instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 on hv-cinder-84617 Jul 18 16:54:13.553710 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-1cba82c3-7236-4d3f-b690-121112c70efe req-91843f64-d27a-4fd8-8640-4de33643d3ca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036939 Jul 18 16:54:13.554602 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 229/439] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:14.160569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-720d265e-8f59-4129-9d9e-98fbc67be43a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:14.160569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-720d265e-8f59-4129-9d9e-98fbc67be43a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:14.160569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-720d265e-8f59-4129-9d9e-98fbc67be43a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.160569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-720d265e-8f59-4129-9d9e-98fbc67be43a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.190585 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-720d265e-8f59-4129-9d9e-98fbc67be43a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.190585 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-720d265e-8f59-4129-9d9e-98fbc67be43a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.238105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-720d265e-8f59-4129-9d9e-98fbc67be43a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:14.244554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-720d265e-8f59-4129-9d9e-98fbc67be43a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.230165 Jul 18 16:54:14.245255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 211/440] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:14 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:15.265551 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ad588746-3d87-42f5-8cdb-d5e82228ffd3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:15.266593 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ad588746-3d87-42f5-8cdb-d5e82228ffd3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:15.273693 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ad588746-3d87-42f5-8cdb-d5e82228ffd3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.274257 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ad588746-3d87-42f5-8cdb-d5e82228ffd3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.275173 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ad588746-3d87-42f5-8cdb-d5e82228ffd3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.275705 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ad588746-3d87-42f5-8cdb-d5e82228ffd3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.421687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ad588746-3d87-42f5-8cdb-d5e82228ffd3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:15.430865 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ad588746-3d87-42f5-8cdb-d5e82228ffd3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1357 microversion: 2.1 time: 0.171991 Jul 18 16:54:15.431748 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 230/441] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:15 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:16.449113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-743f0a50-e0a4-47ac-8d6f-ddda80319f88 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:16.449683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-743f0a50-e0a4-47ac-8d6f-ddda80319f88 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:16.457198 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-743f0a50-e0a4-47ac-8d6f-ddda80319f88 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.457711 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-743f0a50-e0a4-47ac-8d6f-ddda80319f88 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.458488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-743f0a50-e0a4-47ac-8d6f-ddda80319f88 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.458946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-743f0a50-e0a4-47ac-8d6f-ddda80319f88 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.591778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-743f0a50-e0a4-47ac-8d6f-ddda80319f88 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:16.602673 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-743f0a50-e0a4-47ac-8d6f-ddda80319f88 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1547 microversion: 2.1 time: 0.157542 Jul 18 16:54:16.608686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 212/442] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:16 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:16.624120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4f62f83a-79ee-4511-9add-506bd35fe83c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:16.624728 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4f62f83a-79ee-4511-9add-506bd35fe83c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:16.632867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4f62f83a-79ee-4511-9add-506bd35fe83c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.639146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4f62f83a-79ee-4511-9add-506bd35fe83c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.639146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4f62f83a-79ee-4511-9add-506bd35fe83c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.639146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4f62f83a-79ee-4511-9add-506bd35fe83c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.767252 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4f62f83a-79ee-4511-9add-506bd35fe83c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:16.776082 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4f62f83a-79ee-4511-9add-506bd35fe83c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1547 microversion: 2.1 time: 0.155889 Jul 18 16:54:16.776692 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 231/443] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:16 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:16.791791 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:16.795292 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:16.796051 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Searching by: {'deleted': False, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a'} {{(pid=124754) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 16:54:16.802714 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.803158 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.803948 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.804388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.901805 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.multi_cell_list [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124754) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 16:54:17.017946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b3a266d4-d7e8-4059-ab0b-5dfed41dd550 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229907 Jul 18 16:54:17.018530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 213/444] 10.222.0.88 () {58 vars in 1124 bytes} [Mon Jul 18 16:54:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:17.029446 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f47bb398-3b74-45d0-b68b-8f90f716ce34 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:17.030562 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f47bb398-3b74-45d0-b68b-8f90f716ce34 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:17.036780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f47bb398-3b74-45d0-b68b-8f90f716ce34 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.040205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f47bb398-3b74-45d0-b68b-8f90f716ce34 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.040205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f47bb398-3b74-45d0-b68b-8f90f716ce34 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.040205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f47bb398-3b74-45d0-b68b-8f90f716ce34 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.178612 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f47bb398-3b74-45d0-b68b-8f90f716ce34 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:17.185985 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f47bb398-3b74-45d0-b68b-8f90f716ce34 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1547 microversion: 2.1 time: 0.160571 Jul 18 16:54:17.187193 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 232/445] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:17 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:17.396982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3eec220f-3ab2-4061-9c77-c02e319acb25 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:17.397632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3eec220f-3ab2-4061-9c77-c02e319acb25 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:17.405083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3eec220f-3ab2-4061-9c77-c02e319acb25 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.405538 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3eec220f-3ab2-4061-9c77-c02e319acb25 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.406330 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3eec220f-3ab2-4061-9c77-c02e319acb25 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:17.406774 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3eec220f-3ab2-4061-9c77-c02e319acb25 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:17.436896 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:17.537423 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-3eec220f-3ab2-4061-9c77-c02e319acb25 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lazy-loading 'services' on Instance uuid 1579d2b5-2f69-4482-a945-a0484d56671c {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:54:17.833570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3eec220f-3ab2-4061-9c77-c02e319acb25 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c/os-volume_attachments/54607dc9-72af-4d4e-a3fb-3fca4aa0558e" status: 202 len: 0 microversion: 2.1 time: 0.441054 Jul 18 16:54:17.834232 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 214/446] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:54:17 2022] DELETE /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c/os-volume_attachments/54607dc9-72af-4d4e-a3fb-3fca4aa0558e => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:54:19.286855 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-238c8bb1-9b6f-4e68-87f3-2471a2a46688 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d57d17f9-c203-4420-9b5d-cb278843e813"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:19.287944 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-238c8bb1-9b6f-4e68-87f3-2471a2a46688 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:19.294352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-238c8bb1-9b6f-4e68-87f3-2471a2a46688 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:19.294794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-238c8bb1-9b6f-4e68-87f3-2471a2a46688 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:19.296168 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-238c8bb1-9b6f-4e68-87f3-2471a2a46688 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:19.296600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-238c8bb1-9b6f-4e68-87f3-2471a2a46688 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:20.009293 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=4 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:20.260902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:20.447427 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-238c8bb1-9b6f-4e68-87f3-2471a2a46688 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "POST /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.164349 Jul 18 16:54:20.450190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 233/447] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:54:19 2022] POST /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments => generated 194 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:21.255422 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0189d74e-4ab9-4ef3-9fd9-a5f39c0d8ea3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:21.256494 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0189d74e-4ab9-4ef3-9fd9-a5f39c0d8ea3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:21.263472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0189d74e-4ab9-4ef3-9fd9-a5f39c0d8ea3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:21.266749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0189d74e-4ab9-4ef3-9fd9-a5f39c0d8ea3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:21.266749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0189d74e-4ab9-4ef3-9fd9-a5f39c0d8ea3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:21.266749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0189d74e-4ab9-4ef3-9fd9-a5f39c0d8ea3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:21.289207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-0189d74e-4ab9-4ef3-9fd9-a5f39c0d8ea3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'flavor' on Instance uuid 5b3504a1-341a-4a72-9cd1-0597e63ffa7d {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:54:21.646539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0189d74e-4ab9-4ef3-9fd9-a5f39c0d8ea3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/action" status: 200 len: 32 microversion: 2.1 time: 0.396652 Jul 18 16:54:21.647148 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 215/448] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:54:21 2022] POST /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/action => generated 32 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:54:21.657284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b299d5bb-7daa-49bb-9ff7-2c3a128a8411 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:21.657994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b299d5bb-7daa-49bb-9ff7-2c3a128a8411 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:21.665278 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b299d5bb-7daa-49bb-9ff7-2c3a128a8411 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:21.665766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b299d5bb-7daa-49bb-9ff7-2c3a128a8411 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:21.666464 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b299d5bb-7daa-49bb-9ff7-2c3a128a8411 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:21.666959 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b299d5bb-7daa-49bb-9ff7-2c3a128a8411 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:21.805463 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b299d5bb-7daa-49bb-9ff7-2c3a128a8411 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:21.814555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b299d5bb-7daa-49bb-9ff7-2c3a128a8411 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.161335 Jul 18 16:54:21.815224 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 234/449] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:21 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:22.134383 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-98c3c824-8adf-4c2f-9be3-8cece023e501 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:22.135239 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-98c3c824-8adf-4c2f-9be3-8cece023e501 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:22.142276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-98c3c824-8adf-4c2f-9be3-8cece023e501 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.142724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-98c3c824-8adf-4c2f-9be3-8cece023e501 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.143504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-98c3c824-8adf-4c2f-9be3-8cece023e501 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.143940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-98c3c824-8adf-4c2f-9be3-8cece023e501 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.169057 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-98c3c824-8adf-4c2f-9be3-8cece023e501 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:54:22.513580 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-98c3c824-8adf-4c2f-9be3-8cece023e501 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 204 len: 0 microversion: 2.1 time: 0.383144 Jul 18 16:54:22.514328 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 216/450] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:54:22 2022] DELETE /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:54:22.522821 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-35501281-88f8-47aa-a063-c9125b4aa41e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:22.523541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-35501281-88f8-47aa-a063-c9125b4aa41e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:22.529626 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35501281-88f8-47aa-a063-c9125b4aa41e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.530194 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35501281-88f8-47aa-a063-c9125b4aa41e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.530955 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35501281-88f8-47aa-a063-c9125b4aa41e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.531392 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35501281-88f8-47aa-a063-c9125b4aa41e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.833112 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e5cb2862-27fb-45ac-b4b9-a793fe5abbee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:22.833741 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e5cb2862-27fb-45ac-b4b9-a793fe5abbee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:22.840685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e5cb2862-27fb-45ac-b4b9-a793fe5abbee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.841175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e5cb2862-27fb-45ac-b4b9-a793fe5abbee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.841951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e5cb2862-27fb-45ac-b4b9-a793fe5abbee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.842892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e5cb2862-27fb-45ac-b4b9-a793fe5abbee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.893115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-35501281-88f8-47aa-a063-c9125b4aa41e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:22.900976 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-35501281-88f8-47aa-a063-c9125b4aa41e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1515 microversion: 2.1 time: 0.382361 Jul 18 16:54:22.901784 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 235/451] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:22 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1515 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:22.983335 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e5cb2862-27fb-45ac-b4b9-a793fe5abbee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:22.991638 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e5cb2862-27fb-45ac-b4b9-a793fe5abbee tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.163161 Jul 18 16:54:22.992221 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 217/452] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:22 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:23.918207 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b0c95947-2874-4676-b42d-088e6a68e183 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:23.918755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b0c95947-2874-4676-b42d-088e6a68e183 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:23.925908 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b0c95947-2874-4676-b42d-088e6a68e183 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:23.926365 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b0c95947-2874-4676-b42d-088e6a68e183 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:23.927141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b0c95947-2874-4676-b42d-088e6a68e183 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:23.927612 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b0c95947-2874-4676-b42d-088e6a68e183 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:24.009292 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-77e78b68-1469-433f-8eca-61a88cffd680 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:24.009901 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-77e78b68-1469-433f-8eca-61a88cffd680 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:24.016473 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-77e78b68-1469-433f-8eca-61a88cffd680 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:24.016951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-77e78b68-1469-433f-8eca-61a88cffd680 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:24.017724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-77e78b68-1469-433f-8eca-61a88cffd680 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:24.018164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-77e78b68-1469-433f-8eca-61a88cffd680 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:24.056798 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b0c95947-2874-4676-b42d-088e6a68e183 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:24.065087 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b0c95947-2874-4676-b42d-088e6a68e183 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1515 microversion: 2.1 time: 0.150733 Jul 18 16:54:24.065676 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 236/453] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:23 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:24.152809 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-77e78b68-1469-433f-8eca-61a88cffd680 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:24.160837 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-77e78b68-1469-433f-8eca-61a88cffd680 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.155436 Jul 18 16:54:24.161475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 218/454] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:24 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:25.083210 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-85c9c003-85dd-41ba-b74e-6ab9ae5d482f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:25.083800 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-85c9c003-85dd-41ba-b74e-6ab9ae5d482f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:25.090178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85c9c003-85dd-41ba-b74e-6ab9ae5d482f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:25.090636 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85c9c003-85dd-41ba-b74e-6ab9ae5d482f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:25.091406 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85c9c003-85dd-41ba-b74e-6ab9ae5d482f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:25.091854 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85c9c003-85dd-41ba-b74e-6ab9ae5d482f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:25.178698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-081d171f-542f-4e49-97ba-ca6f7d7a89c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:25.179485 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-081d171f-542f-4e49-97ba-ca6f7d7a89c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:25.186406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-081d171f-542f-4e49-97ba-ca6f7d7a89c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:25.191949 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-081d171f-542f-4e49-97ba-ca6f7d7a89c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:25.191949 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-081d171f-542f-4e49-97ba-ca6f7d7a89c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:25.191949 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-081d171f-542f-4e49-97ba-ca6f7d7a89c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:25.234663 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-85c9c003-85dd-41ba-b74e-6ab9ae5d482f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:25.242643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-85c9c003-85dd-41ba-b74e-6ab9ae5d482f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1515 microversion: 2.1 time: 0.163499 Jul 18 16:54:25.243261 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 237/455] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:25 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:25.403897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-bf336f0d-4549-4717-98c3-8623fce66727 req-46f4293b-41ce-4f7f-b111-513ecb3102ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1579d2b5-2f69-4482-a945-a0484d56671c", "name": "network-vif-deleted", "tag": "283c8fe9-257c-432d-b922-6a40eb30d5b0"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:25.411462 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-081d171f-542f-4e49-97ba-ca6f7d7a89c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:25.413198 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-bf336f0d-4549-4717-98c3-8623fce66727 req-46f4293b-41ce-4f7f-b111-513ecb3102ad service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:25.413651 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-bf336f0d-4549-4717-98c3-8623fce66727 req-46f4293b-41ce-4f7f-b111-513ecb3102ad service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:25.421066 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-081d171f-542f-4e49-97ba-ca6f7d7a89c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.246520 Jul 18 16:54:25.427579 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-bf336f0d-4549-4717-98c3-8623fce66727 req-46f4293b-41ce-4f7f-b111-513ecb3102ad service nova] Creating event network-vif-deleted:283c8fe9-257c-432d-b922-6a40eb30d5b0 for instance 1579d2b5-2f69-4482-a945-a0484d56671c on hv-cinder-84617 Jul 18 16:54:25.431623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 219/456] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:25 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:25.435841 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-bf336f0d-4549-4717-98c3-8623fce66727 req-46f4293b-41ce-4f7f-b111-513ecb3102ad service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037319 Jul 18 16:54:25.440405 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 238/457] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:26.260472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:26.261128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:26.267635 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.268086 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.268849 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.269309 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.300281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.300726 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.301200 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lazy-loading 'fault' on Instance uuid 1579d2b5-2f69-4482-a945-a0484d56671c {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:54:26.344744 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:26.352215 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-760c451c-58db-4a0f-b78e-590f8050872e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 200 len: 1309 microversion: 2.1 time: 0.095701 Jul 18 16:54:26.352832 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 220/458] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:26 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:26.439895 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-420d1e68-f2d6-42a4-a578-8f860c4af9dd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:26.440591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-420d1e68-f2d6-42a4-a578-8f860c4af9dd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:26.446885 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-420d1e68-f2d6-42a4-a578-8f860c4af9dd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.447421 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-420d1e68-f2d6-42a4-a578-8f860c4af9dd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.448199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-420d1e68-f2d6-42a4-a578-8f860c4af9dd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.448713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-420d1e68-f2d6-42a4-a578-8f860c4af9dd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.587296 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-420d1e68-f2d6-42a4-a578-8f860c4af9dd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:26.595622 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-420d1e68-f2d6-42a4-a578-8f860c4af9dd tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.160469 Jul 18 16:54:26.596187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 239/459] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:26 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:27.368790 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:27.369482 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: 1579d2b5-2f69-4482-a945-a0484d56671c] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:27.371523 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:27.377106 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:27.377496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:27.378262 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:27.379881 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:27.394728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] HTTP exception thrown: Instance 1579d2b5-2f69-4482-a945-a0484d56671c could not be found. Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Request method failure captured: Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c HTTP/1.1 Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y_xER0ehBJqS8dovWPiQl61YkGa0cNaRUi9gBbiMjGUqSWrnwPfgeaWH2G2ApUE7u5Q6qcjRru7YhlEVsoSRyWqzv40zSqbal08MymkZEwfojTVAu2MA7xGBQ9Q355ni6X4IRI09GItYMKhwjtyx_BygfaYJAYe-zuSH031D1o13MI Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 4fe102d227ea4f60bdf22c20cd028341 Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1428294010 Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:54:27.396359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4fe102d227ea4f60bdf22c20cd028341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4fe102d227ea4f60bdf22c20cd028341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4fe102d227ea4f60bdf22c20cd028341", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4fe102d227ea4f60bdf22c20cd028341"}]}] Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-VolumesSnapshotTestJSON-1428294010 Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 4fe102d227ea4f60bdf22c20cd028341 Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1428294010 Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-VolumesSnapshotTestJSON-1428294010-project Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 81d0641fc86a43f7a6c772add1e2ae48 Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-VolumesSnapshotTestJSON-1428294010-project Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 1579d2b5-2f69-4482-a945-a0484d56671c could not be found. Jul 18 16:54:27.398250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '1579d2b5-2f69-4482-a945-a0484d56671c'} Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1579d2b5-2f69-4482-a945-a0484d56671c could not be found. Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:54:27.399246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1579d2b5-2f69-4482-a945-a0484d56671c could not be found. Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1579d2b5-2f69-4482-a945-a0484d56671c could not be found. Jul 18 16:54:27.401190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:27.402354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Returning 404 to user: Instance 1579d2b5-2f69-4482-a945-a0484d56671c could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:54:27.402354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c349e12d-9f06-43b5-9182-ad8e5e20e6a8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c" status: 404 len: 111 microversion: 2.1 time: 0.032909 Jul 18 16:54:27.402354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 221/460] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:27 2022] GET /compute/v2.1/servers/1579d2b5-2f69-4482-a945-a0484d56671c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:54:27.612599 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4e84ef6d-a696-4041-9168-360cca80bd01 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:27.613274 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4e84ef6d-a696-4041-9168-360cca80bd01 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:27.620353 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4e84ef6d-a696-4041-9168-360cca80bd01 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:27.620830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4e84ef6d-a696-4041-9168-360cca80bd01 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:27.621637 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4e84ef6d-a696-4041-9168-360cca80bd01 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:27.622099 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4e84ef6d-a696-4041-9168-360cca80bd01 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:27.755483 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4e84ef6d-a696-4041-9168-360cca80bd01 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:27.764238 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4e84ef6d-a696-4041-9168-360cca80bd01 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.155111 Jul 18 16:54:27.764811 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 240/461] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:27 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:28.787424 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5a587142-788c-4ebd-9dc6-e0ee9fdf4e2f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:28.788023 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5a587142-788c-4ebd-9dc6-e0ee9fdf4e2f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:28.794773 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a587142-788c-4ebd-9dc6-e0ee9fdf4e2f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:28.795218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a587142-788c-4ebd-9dc6-e0ee9fdf4e2f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:28.795975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a587142-788c-4ebd-9dc6-e0ee9fdf4e2f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:28.796461 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a587142-788c-4ebd-9dc6-e0ee9fdf4e2f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:28.938938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5a587142-788c-4ebd-9dc6-e0ee9fdf4e2f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:28.948833 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5a587142-788c-4ebd-9dc6-e0ee9fdf4e2f tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.165671 Jul 18 16:54:28.949511 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 222/462] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:28 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:29.966158 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0ebe7f8b-a73e-4ffe-afe4-fcc673030c49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:29.966763 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0ebe7f8b-a73e-4ffe-afe4-fcc673030c49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:29.974386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f8b-a73e-4ffe-afe4-fcc673030c49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:29.974833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f8b-a73e-4ffe-afe4-fcc673030c49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:29.975607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f8b-a73e-4ffe-afe4-fcc673030c49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:29.976039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0ebe7f8b-a73e-4ffe-afe4-fcc673030c49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:30.107871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0ebe7f8b-a73e-4ffe-afe4-fcc673030c49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:30.116328 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0ebe7f8b-a73e-4ffe-afe4-fcc673030c49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.153948 Jul 18 16:54:30.116901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 241/463] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:29 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:31.133177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-634ae28d-a435-4293-90ce-100de42c0898 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:31.133939 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-634ae28d-a435-4293-90ce-100de42c0898 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:31.140125 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-634ae28d-a435-4293-90ce-100de42c0898 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:31.140571 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-634ae28d-a435-4293-90ce-100de42c0898 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:31.141353 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-634ae28d-a435-4293-90ce-100de42c0898 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:31.141784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-634ae28d-a435-4293-90ce-100de42c0898 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:31.291474 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-634ae28d-a435-4293-90ce-100de42c0898 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:31.300356 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-634ae28d-a435-4293-90ce-100de42c0898 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.170968 Jul 18 16:54:31.300969 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 223/464] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:31 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:32.318081 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-aa3b2c32-11a9-499d-9805-be0e4b8bad34 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:32.318694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-aa3b2c32-11a9-499d-9805-be0e4b8bad34 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:32.325136 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-aa3b2c32-11a9-499d-9805-be0e4b8bad34 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:32.325591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-aa3b2c32-11a9-499d-9805-be0e4b8bad34 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:32.326374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-aa3b2c32-11a9-499d-9805-be0e4b8bad34 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:32.326837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-aa3b2c32-11a9-499d-9805-be0e4b8bad34 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:32.459393 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-aa3b2c32-11a9-499d-9805-be0e4b8bad34 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:32.467868 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-aa3b2c32-11a9-499d-9805-be0e4b8bad34 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.153511 Jul 18 16:54:32.468484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 242/465] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:32 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:33.274626 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e19e4428-905c-4aaa-94df-7c50cad0b32a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:33.275234 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e19e4428-905c-4aaa-94df-7c50cad0b32a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:33.282697 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e19e4428-905c-4aaa-94df-7c50cad0b32a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:33.283479 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e19e4428-905c-4aaa-94df-7c50cad0b32a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:33.283938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e19e4428-905c-4aaa-94df-7c50cad0b32a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:33.284458 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e19e4428-905c-4aaa-94df-7c50cad0b32a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:33.422507 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e19e4428-905c-4aaa-94df-7c50cad0b32a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:33.430777 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e19e4428-905c-4aaa-94df-7c50cad0b32a tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1593 microversion: 2.1 time: 0.160053 Jul 18 16:54:33.432193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 224/466] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:33 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1593 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:33.485245 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0560f69c-1a79-4b4d-bb0e-e7b2d646d1f1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:33.485801 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0560f69c-1a79-4b4d-bb0e-e7b2d646d1f1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:33.492704 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0560f69c-1a79-4b4d-bb0e-e7b2d646d1f1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:33.493228 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0560f69c-1a79-4b4d-bb0e-e7b2d646d1f1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:33.494151 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0560f69c-1a79-4b4d-bb0e-e7b2d646d1f1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:33.494648 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0560f69c-1a79-4b4d-bb0e-e7b2d646d1f1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:33.685167 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0560f69c-1a79-4b4d-bb0e-e7b2d646d1f1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:33.693731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0560f69c-1a79-4b4d-bb0e-e7b2d646d1f1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.212927 Jul 18 16:54:33.694309 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 243/467] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:33 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:34.711519 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-16e854a4-79d6-4b10-96f6-b4de0c521eb5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:34.712254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-16e854a4-79d6-4b10-96f6-b4de0c521eb5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:34.719922 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-16e854a4-79d6-4b10-96f6-b4de0c521eb5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:34.720416 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-16e854a4-79d6-4b10-96f6-b4de0c521eb5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:34.721216 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-16e854a4-79d6-4b10-96f6-b4de0c521eb5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:34.721650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-16e854a4-79d6-4b10-96f6-b4de0c521eb5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:34.867891 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-16e854a4-79d6-4b10-96f6-b4de0c521eb5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:34.871344 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-16e854a4-79d6-4b10-96f6-b4de0c521eb5 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.163878 Jul 18 16:54:34.871952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 225/468] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:34 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:35.571693 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-41736a63-8f59-4ddb-97fa-c473e8609272 req-64d0d481-fda8-490d-8789-d0a7678f88d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f88bfc-2675-40e9-a413-ab95f2b7ad36", "tag": "38643ba4-8900-42fa-86db-6a74e9ac1a2e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:35.581634 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-41736a63-8f59-4ddb-97fa-c473e8609272 req-64d0d481-fda8-490d-8789-d0a7678f88d5 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:35.582291 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-41736a63-8f59-4ddb-97fa-c473e8609272 req-64d0d481-fda8-490d-8789-d0a7678f88d5 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:35.594841 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-41736a63-8f59-4ddb-97fa-c473e8609272 req-64d0d481-fda8-490d-8789-d0a7678f88d5 service nova] Creating event network-changed:38643ba4-8900-42fa-86db-6a74e9ac1a2e for instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 on hv-cinder-84617 Jul 18 16:54:35.600246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-41736a63-8f59-4ddb-97fa-c473e8609272 req-64d0d481-fda8-490d-8789-d0a7678f88d5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032548 Jul 18 16:54:35.601422 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 244/469] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:35.891607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-436ab0ec-25de-4000-af77-1b88c874cdaa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:35.891607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-436ab0ec-25de-4000-af77-1b88c874cdaa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:35.896807 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-436ab0ec-25de-4000-af77-1b88c874cdaa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:35.897279 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-436ab0ec-25de-4000-af77-1b88c874cdaa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:35.898043 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-436ab0ec-25de-4000-af77-1b88c874cdaa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:35.898472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-436ab0ec-25de-4000-af77-1b88c874cdaa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:36.040832 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-436ab0ec-25de-4000-af77-1b88c874cdaa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:36.044708 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:36.050621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-436ab0ec-25de-4000-af77-1b88c874cdaa tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.166096 Jul 18 16:54:36.060156 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 226/470] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:35 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:37.068941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4626bebf-67f6-452b-bdbf-e153f0c04750 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:37.072596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4626bebf-67f6-452b-bdbf-e153f0c04750 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:37.072596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:37.077337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4626bebf-67f6-452b-bdbf-e153f0c04750 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:37.077790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4626bebf-67f6-452b-bdbf-e153f0c04750 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:37.078583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4626bebf-67f6-452b-bdbf-e153f0c04750 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:37.079009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4626bebf-67f6-452b-bdbf-e153f0c04750 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:37.229402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4626bebf-67f6-452b-bdbf-e153f0c04750 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:37.238425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4626bebf-67f6-452b-bdbf-e153f0c04750 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.174063 Jul 18 16:54:37.239367 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 245/471] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:37 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:38.026734 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-133880705", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "networks": [{"uuid": "28c3a16e-a4d5-4be8-99b2-9dc17a6f5299"}]}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:38.083895 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] validate_networks() for [('28c3a16e-a4d5-4be8-99b2-9dc17a6f5299', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:54:38.256715 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-35fcd166-c3a4-4db1-8114-2e118c2f4403 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:38.257560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-35fcd166-c3a4-4db1-8114-2e118c2f4403 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:38.265095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35fcd166-c3a4-4db1-8114-2e118c2f4403 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.265638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35fcd166-c3a4-4db1-8114-2e118c2f4403 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.266480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35fcd166-c3a4-4db1-8114-2e118c2f4403 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.266985 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35fcd166-c3a4-4db1-8114-2e118c2f4403 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.440101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-35fcd166-c3a4-4db1-8114-2e118c2f4403 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:38.449695 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-35fcd166-c3a4-4db1-8114-2e118c2f4403 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.196780 Jul 18 16:54:38.450284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 246/472] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:38 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:38.451276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:54:38.452610 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:54:38.453103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:54:38.453508 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:54:38.454131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:54:38.457661 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:38.464778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.465278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.466073 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.466502 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.485437 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Getting quotas for project 4fe102d227ea4f60bdf22c20cd028341. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:54:38.489656 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Getting quotas for user 81d0641fc86a43f7a6c772add1e2ae48 and project 4fe102d227ea4f60bdf22c20cd028341. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:54:38.501761 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:54:38.503991 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:54:38.660220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-18fdbb4a-0d78-4ceb-844b-0def3def926c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637341 Jul 18 16:54:38.660848 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 227/473] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:54:38.671469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d61ac72e-03ef-4be8-9128-98e523fc87bf tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:38.672133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d61ac72e-03ef-4be8-9128-98e523fc87bf tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:38.728148 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d61ac72e-03ef-4be8-9128-98e523fc87bf tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:38.736658 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-577c6415-02ab-408b-a27b-654ae42bd851 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1202975513"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:38.737155 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-577c6415-02ab-408b-a27b-654ae42bd851 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:38.739214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d61ac72e-03ef-4be8-9128-98e523fc87bf tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1218 microversion: 2.1 time: 0.072010 Jul 18 16:54:38.739813 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 247/474] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:38 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:38.744090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-577c6415-02ab-408b-a27b-654ae42bd851 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.744545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-577c6415-02ab-408b-a27b-654ae42bd851 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.746129 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-577c6415-02ab-408b-a27b-654ae42bd851 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.746733 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-577c6415-02ab-408b-a27b-654ae42bd851 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.903798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.network.security_group_api [None req-577c6415-02ab-408b-a27b-654ae42bd851 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Adding security group 3230954e-64b6-4517-8ebb-8055af4c8541 to port 38643ba4-8900-42fa-86db-6a74e9ac1a2e Jul 18 16:54:39.230713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-969542529", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-328566045", "security_groups": [{"name": "tempest-secgroup-smoke-122793974"}], "block_device_mapping_v2": [{"uuid": "42e8e64f-b7f2-4446-8fba-cd5e1886f88b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925915ce-ec30-4da0-b91d-e4af79017b65"}]}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:39.343053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-577c6415-02ab-408b-a27b-654ae42bd851 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "POST /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/action" status: 202 len: 0 microversion: 2.1 time: 0.609807 Jul 18 16:54:39.343778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 228/475] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:54:38 2022] POST /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:54:39.354708 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0a56f6ba-e16c-4d90-a819-cdbf1f7929cc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:39.355327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0a56f6ba-e16c-4d90-a819-cdbf1f7929cc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:39.371395 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0a56f6ba-e16c-4d90-a819-cdbf1f7929cc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.371857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0a56f6ba-e16c-4d90-a819-cdbf1f7929cc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.372641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0a56f6ba-e16c-4d90-a819-cdbf1f7929cc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.373100 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0a56f6ba-e16c-4d90-a819-cdbf1f7929cc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.373872 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] validate_networks() for [('925915ce-ec30-4da0-b91d-e4af79017b65', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:54:39.585091 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0a56f6ba-e16c-4d90-a819-cdbf1f7929cc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:39.602039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0a56f6ba-e16c-4d90-a819-cdbf1f7929cc tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1758 microversion: 2.1 time: 0.250936 Jul 18 16:54:39.602838 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 229/476] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:39 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1758 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:39.610902 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-e0955bc9-3003-43b2-93e3-472afa4b2a66 req-b1345197-f42a-4c95-a335-eaf09bc8982f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f88bfc-2675-40e9-a413-ab95f2b7ad36", "tag": "38643ba4-8900-42fa-86db-6a74e9ac1a2e"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:39.625223 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-e0955bc9-3003-43b2-93e3-472afa4b2a66 req-b1345197-f42a-4c95-a335-eaf09bc8982f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.625223 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-e0955bc9-3003-43b2-93e3-472afa4b2a66 req-b1345197-f42a-4c95-a335-eaf09bc8982f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.635845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-e0955bc9-3003-43b2-93e3-472afa4b2a66 req-b1345197-f42a-4c95-a335-eaf09bc8982f service nova] Creating event network-changed:38643ba4-8900-42fa-86db-6a74e9ac1a2e for instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 on hv-cinder-84617 Jul 18 16:54:39.641216 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-e0955bc9-3003-43b2-93e3-472afa4b2a66 req-b1345197-f42a-4c95-a335-eaf09bc8982f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036831 Jul 18 16:54:39.644863 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 230/477] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:39.650401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7a52155c-3b0f-44fd-b0b9-8fcf8dbbb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:39.651274 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7a52155c-3b0f-44fd-b0b9-8fcf8dbbb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:39.658154 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7a52155c-3b0f-44fd-b0b9-8fcf8dbbb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.658536 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7a52155c-3b0f-44fd-b0b9-8fcf8dbbb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.659298 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7a52155c-3b0f-44fd-b0b9-8fcf8dbbb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.659767 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7a52155c-3b0f-44fd-b0b9-8fcf8dbbb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.875389 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:54:39.876098 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:54:39.876826 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:54:39.877444 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:54:39.878041 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:54:39.888848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.890181 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.891453 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.892126 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.918491 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Getting quotas for project 5d68154d9fdb40f0848b676c1fed6a50. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:54:39.924407 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7a52155c-3b0f-44fd-b0b9-8fcf8dbbb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:39.940042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Getting quotas for user cd69c5111dac492a9177128317f0962a and project 5d68154d9fdb40f0848b676c1fed6a50. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:54:39.942516 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7a52155c-3b0f-44fd-b0b9-8fcf8dbbb131 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.292732 Jul 18 16:54:39.944577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 231/478] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:39 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:39.955788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4e02aca0-f51e-48ed-8cf8-81dcdbf6b07c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:39.956408 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4e02aca0-f51e-48ed-8cf8-81dcdbf6b07c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:39.979015 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e02aca0-f51e-48ed-8cf8-81dcdbf6b07c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.979462 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e02aca0-f51e-48ed-8cf8-81dcdbf6b07c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.984980 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e02aca0-f51e-48ed-8cf8-81dcdbf6b07c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.985826 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e02aca0-f51e-48ed-8cf8-81dcdbf6b07c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:40.042513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:54:40.044666 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42e8e64f-b7f2-4446-8fba-cd5e1886f88b',volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:54:40.066078 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4e02aca0-f51e-48ed-8cf8-81dcdbf6b07c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:40.101608 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4e02aca0-f51e-48ed-8cf8-81dcdbf6b07c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1222 microversion: 2.1 time: 0.143810 Jul 18 16:54:40.101608 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 232/479] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:39 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:40.606652 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-68d25a34-142b-4246-ad43-a2ada1a08adc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.381503 Jul 18 16:54:40.607375 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 248/480] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:54:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:54:40.618187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8aa67faa-653d-439a-bafe-29bbebdf0660 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:40.618788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8aa67faa-653d-439a-bafe-29bbebdf0660 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:40.676868 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8aa67faa-653d-439a-bafe-29bbebdf0660 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:40.685055 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8aa67faa-653d-439a-bafe-29bbebdf0660 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1093 microversion: 2.1 time: 0.070115 Jul 18 16:54:40.685655 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 233/481] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:40 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:40.962754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3495329c-c118-4b21-ab65-7187ea9d78a7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:40.963362 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3495329c-c118-4b21-ab65-7187ea9d78a7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:40.970428 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3495329c-c118-4b21-ab65-7187ea9d78a7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:40.970886 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3495329c-c118-4b21-ab65-7187ea9d78a7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:40.971672 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3495329c-c118-4b21-ab65-7187ea9d78a7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:40.972114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3495329c-c118-4b21-ab65-7187ea9d78a7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:41.109450 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a5006328-3ad6-4690-b53f-bedc6c6f81b6 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:41.110677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a5006328-3ad6-4690-b53f-bedc6c6f81b6 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:41.117654 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a5006328-3ad6-4690-b53f-bedc6c6f81b6 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:41.118111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a5006328-3ad6-4690-b53f-bedc6c6f81b6 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:41.118932 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a5006328-3ad6-4690-b53f-bedc6c6f81b6 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:41.119367 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a5006328-3ad6-4690-b53f-bedc6c6f81b6 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:41.122745 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3495329c-c118-4b21-ab65-7187ea9d78a7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:41.131491 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3495329c-c118-4b21-ab65-7187ea9d78a7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.172669 Jul 18 16:54:41.137468 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 249/482] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:40 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:41.214373 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a5006328-3ad6-4690-b53f-bedc6c6f81b6 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:41.223101 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a5006328-3ad6-4690-b53f-bedc6c6f81b6 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1278 microversion: 2.1 time: 0.118449 Jul 18 16:54:41.223676 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 234/483] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:41 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:41.703687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4e3379f6-cf02-49b2-983b-5cc9bb40a911 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:41.704623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4e3379f6-cf02-49b2-983b-5cc9bb40a911 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:41.711406 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4e3379f6-cf02-49b2-983b-5cc9bb40a911 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:41.711859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4e3379f6-cf02-49b2-983b-5cc9bb40a911 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:41.712670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4e3379f6-cf02-49b2-983b-5cc9bb40a911 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:41.713149 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4e3379f6-cf02-49b2-983b-5cc9bb40a911 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:41.795149 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4e3379f6-cf02-49b2-983b-5cc9bb40a911 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:41.808789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4e3379f6-cf02-49b2-983b-5cc9bb40a911 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1143 microversion: 2.1 time: 0.108912 Jul 18 16:54:41.809764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 250/484] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:41 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1143 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:42.156686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-45bdb2b9-a307-47ad-902f-b73d0197d41e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:42.157577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-45bdb2b9-a307-47ad-902f-b73d0197d41e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:42.167884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45bdb2b9-a307-47ad-902f-b73d0197d41e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.171681 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45bdb2b9-a307-47ad-902f-b73d0197d41e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.171681 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45bdb2b9-a307-47ad-902f-b73d0197d41e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.171681 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45bdb2b9-a307-47ad-902f-b73d0197d41e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.241156 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7ad13699-5a36-46a4-bd05-cf6ee1d59c73 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:42.241767 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7ad13699-5a36-46a4-bd05-cf6ee1d59c73 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:42.249724 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7ad13699-5a36-46a4-bd05-cf6ee1d59c73 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.257792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7ad13699-5a36-46a4-bd05-cf6ee1d59c73 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.257792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7ad13699-5a36-46a4-bd05-cf6ee1d59c73 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.257792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7ad13699-5a36-46a4-bd05-cf6ee1d59c73 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.395889 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7ad13699-5a36-46a4-bd05-cf6ee1d59c73 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:42.398969 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-45bdb2b9-a307-47ad-902f-b73d0197d41e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:42.404074 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7ad13699-5a36-46a4-bd05-cf6ee1d59c73 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.166780 Jul 18 16:54:42.405197 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 251/485] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:42 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:42.423867 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-45bdb2b9-a307-47ad-902f-b73d0197d41e tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.261128 Jul 18 16:54:42.423867 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 235/486] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:42 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:42.826081 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d0c4ab8b-31ad-4f6b-acb4-ff31096a85bf tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:42.826715 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d0c4ab8b-31ad-4f6b-acb4-ff31096a85bf tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:42.834582 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab8b-31ad-4f6b-acb4-ff31096a85bf tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.839724 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab8b-31ad-4f6b-acb4-ff31096a85bf tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.843209 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab8b-31ad-4f6b-acb4-ff31096a85bf tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.843898 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d0c4ab8b-31ad-4f6b-acb4-ff31096a85bf tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.902354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-8120bf71-44f3-44ab-8669-20d6fc3e2503 req-69cdf2ac-ff32-469a-be4d-5e0db4977b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0010eb6-67ea-4a2a-8684-87247f78b6ce", "tag": "6c131419-d2f0-46b1-88f4-f0b44fbdd035"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:42.912724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-8120bf71-44f3-44ab-8669-20d6fc3e2503 req-69cdf2ac-ff32-469a-be4d-5e0db4977b8f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.913287 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-8120bf71-44f3-44ab-8669-20d6fc3e2503 req-69cdf2ac-ff32-469a-be4d-5e0db4977b8f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.925786 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-8120bf71-44f3-44ab-8669-20d6fc3e2503 req-69cdf2ac-ff32-469a-be4d-5e0db4977b8f service nova] Creating event network-changed:6c131419-d2f0-46b1-88f4-f0b44fbdd035 for instance c0010eb6-67ea-4a2a-8684-87247f78b6ce on hv-cinder-84617 Jul 18 16:54:42.930845 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d0c4ab8b-31ad-4f6b-acb4-ff31096a85bf tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:42.932596 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-8120bf71-44f3-44ab-8669-20d6fc3e2503 req-69cdf2ac-ff32-469a-be4d-5e0db4977b8f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033827 Jul 18 16:54:42.933786 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 236/487] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:42.934404 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:42.939398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d0c4ab8b-31ad-4f6b-acb4-ff31096a85bf tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1191 microversion: 2.1 time: 0.117194 Jul 18 16:54:42.939992 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 252/488] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:42 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1191 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:43.432422 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2f2b1a41-1721-4f89-b258-443bf493aca8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:43.433152 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2f2b1a41-1721-4f89-b258-443bf493aca8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:43.439778 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2fb7cbe2-4dc3-42c8-9c24-6d19589fc838 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:43.440478 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2fb7cbe2-4dc3-42c8-9c24-6d19589fc838 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:43.440598 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a41-1721-4f89-b258-443bf493aca8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.441065 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a41-1721-4f89-b258-443bf493aca8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.441842 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a41-1721-4f89-b258-443bf493aca8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.442282 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a41-1721-4f89-b258-443bf493aca8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.447570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2fb7cbe2-4dc3-42c8-9c24-6d19589fc838 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.448028 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2fb7cbe2-4dc3-42c8-9c24-6d19589fc838 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.448801 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2fb7cbe2-4dc3-42c8-9c24-6d19589fc838 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.449268 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2fb7cbe2-4dc3-42c8-9c24-6d19589fc838 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.577460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2f2b1a41-1721-4f89-b258-443bf493aca8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:43.581103 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2fb7cbe2-4dc3-42c8-9c24-6d19589fc838 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:43.585548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2f2b1a41-1721-4f89-b258-443bf493aca8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.157472 Jul 18 16:54:43.586130 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 237/489] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:43 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:43.589081 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2fb7cbe2-4dc3-42c8-9c24-6d19589fc838 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.153784 Jul 18 16:54:43.589645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 253/490] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:43 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:43.959094 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-061151b3-a9bf-4e5b-849d-be92f98504e7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:43.959701 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-061151b3-a9bf-4e5b-849d-be92f98504e7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:43.965760 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-061151b3-a9bf-4e5b-849d-be92f98504e7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.966205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-061151b3-a9bf-4e5b-849d-be92f98504e7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.967575 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-061151b3-a9bf-4e5b-849d-be92f98504e7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:43.967916 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-061151b3-a9bf-4e5b-849d-be92f98504e7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.118985 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-061151b3-a9bf-4e5b-849d-be92f98504e7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:44.127459 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-061151b3-a9bf-4e5b-849d-be92f98504e7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1199 microversion: 2.1 time: 0.172196 Jul 18 16:54:44.128482 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 238/491] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:43 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1199 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:44.603181 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8afbeeb3-e42f-49e1-ba0c-3d6a0f1434ce tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:44.603761 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8afbeeb3-e42f-49e1-ba0c-3d6a0f1434ce tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:44.611329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8afbeeb3-e42f-49e1-ba0c-3d6a0f1434ce tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.614755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8afbeeb3-e42f-49e1-ba0c-3d6a0f1434ce tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.614885 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7bd61c43-96bc-4056-9d62-550cb6737960 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:44.615329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8afbeeb3-e42f-49e1-ba0c-3d6a0f1434ce tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.615429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7bd61c43-96bc-4056-9d62-550cb6737960 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:44.615520 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8afbeeb3-e42f-49e1-ba0c-3d6a0f1434ce tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.619703 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7bd61c43-96bc-4056-9d62-550cb6737960 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.620160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7bd61c43-96bc-4056-9d62-550cb6737960 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.620962 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7bd61c43-96bc-4056-9d62-550cb6737960 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.621446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7bd61c43-96bc-4056-9d62-550cb6737960 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.754212 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8afbeeb3-e42f-49e1-ba0c-3d6a0f1434ce tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:44.761751 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8afbeeb3-e42f-49e1-ba0c-3d6a0f1434ce tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.162488 Jul 18 16:54:44.762335 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 254/492] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:44 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:44.920353 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7bd61c43-96bc-4056-9d62-550cb6737960 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:44.928430 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7bd61c43-96bc-4056-9d62-550cb6737960 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1735 microversion: 2.1 time: 0.320669 Jul 18 16:54:44.929026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 239/493] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:44 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:45.144750 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-05dad7a4-adbf-4134-93fb-1d016fb6b6f2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:45.145296 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-05dad7a4-adbf-4134-93fb-1d016fb6b6f2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:45.151458 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-05dad7a4-adbf-4134-93fb-1d016fb6b6f2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.151916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-05dad7a4-adbf-4134-93fb-1d016fb6b6f2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.152700 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-05dad7a4-adbf-4134-93fb-1d016fb6b6f2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.153184 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-05dad7a4-adbf-4134-93fb-1d016fb6b6f2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.221218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-05dad7a4-adbf-4134-93fb-1d016fb6b6f2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:45.229075 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-05dad7a4-adbf-4134-93fb-1d016fb6b6f2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1209 microversion: 2.1 time: 0.088243 Jul 18 16:54:45.229642 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 255/494] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:45 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:45.779419 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-31b46d3f-275d-4242-b81e-7d17d8cddc78 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:45.780581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-31b46d3f-275d-4242-b81e-7d17d8cddc78 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:45.789112 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-31b46d3f-275d-4242-b81e-7d17d8cddc78 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.789427 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-31b46d3f-275d-4242-b81e-7d17d8cddc78 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.790236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-31b46d3f-275d-4242-b81e-7d17d8cddc78 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.790674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-31b46d3f-275d-4242-b81e-7d17d8cddc78 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.948323 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3132e3cc-2356-4de2-882e-8ff97845185c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:45.949022 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3132e3cc-2356-4de2-882e-8ff97845185c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:45.956232 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3132e3cc-2356-4de2-882e-8ff97845185c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.956691 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3132e3cc-2356-4de2-882e-8ff97845185c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.957511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3132e3cc-2356-4de2-882e-8ff97845185c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.957955 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3132e3cc-2356-4de2-882e-8ff97845185c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.962303 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-31b46d3f-275d-4242-b81e-7d17d8cddc78 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:45.966371 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-31b46d3f-275d-4242-b81e-7d17d8cddc78 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.191003 Jul 18 16:54:45.967178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 240/495] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:45 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:46.100341 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3132e3cc-2356-4de2-882e-8ff97845185c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:46.113831 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3132e3cc-2356-4de2-882e-8ff97845185c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1715 microversion: 2.1 time: 0.167554 Jul 18 16:54:46.113831 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 256/496] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:45 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:46.225892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:46.226390 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:46.232496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.234512 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.235348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.235789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.247980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c19363f4-b122-42d3-a71d-19d1ae2aab6f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:46.249227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c19363f4-b122-42d3-a71d-19d1ae2aab6f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:46.257482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c19363f4-b122-42d3-a71d-19d1ae2aab6f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.257942 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c19363f4-b122-42d3-a71d-19d1ae2aab6f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.258996 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c19363f4-b122-42d3-a71d-19d1ae2aab6f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.259726 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c19363f4-b122-42d3-a71d-19d1ae2aab6f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.326835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] HTTP exception thrown: Cannot 'detach_volume' instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d while it is in vm_state rescued Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Request method failure captured: Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: DELETE /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments/c1672945-d502-4d41-b9ce-85a02e9880bc HTTP/1.1 Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y9CIuTubgqM74W1_pbe5k_tS6w9g7u9d3gDr9ZZ8_vU18vhSPDw4nQcs-sVbcs5CF14wI4yvButN1_qeoJe8XiWbIdGlymLgi-J1tlXq7Xbpn2ppklDf0u5U6c4ygl78ZQGY7WJNvxgE-ikmjSI_UwxizhN8rPrNBLY8DvlKOhUiOE Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:54:46.329438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6299ea3e56e84d3cbd2e8f74ef62510e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}] Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: f2d1f86034b94e289bb1fc754f02f4ac Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:54:46.331046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Cannot 'detach_volume' instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d while it is in vm_state rescued Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'server_id': '5b3504a1-341a-4a72-9cd1-0597e63ffa7d', 'id': 'c1672945-d502-4d41-b9ce-85a02e9880bc'} Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:54:46.331876 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d while it is in vm_state rescued Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d while it is in vm_state rescued Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:54:46.337649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Returning 409 to user: Cannot 'detach_volume' instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d while it is in vm_state rescued {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:54:46.339095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2824557d-7333-42cf-a45f-36f511c54168 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments/c1672945-d502-4d41-b9ce-85a02e9880bc" status: 409 len: 152 microversion: 2.1 time: 0.113756 Jul 18 16:54:46.339095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 241/497] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:54:46 2022] DELETE /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments/c1672945-d502-4d41-b9ce-85a02e9880bc => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:54:46.344911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e00ede7e-abbd-4bfe-b665-0afc11c50ef1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:46.345467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e00ede7e-abbd-4bfe-b665-0afc11c50ef1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:46.353098 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e00ede7e-abbd-4bfe-b665-0afc11c50ef1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.353567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e00ede7e-abbd-4bfe-b665-0afc11c50ef1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.354351 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e00ede7e-abbd-4bfe-b665-0afc11c50ef1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.355157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e00ede7e-abbd-4bfe-b665-0afc11c50ef1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.419660 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c19363f4-b122-42d3-a71d-19d1ae2aab6f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:46.428269 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c19363f4-b122-42d3-a71d-19d1ae2aab6f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1276 microversion: 2.1 time: 0.185087 Jul 18 16:54:46.429171 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 257/498] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:46 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:46.612130 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e00ede7e-abbd-4bfe-b665-0afc11c50ef1 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "POST /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/action" status: 202 len: 0 microversion: 2.1 time: 0.271579 Jul 18 16:54:46.615361 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 242/499] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:54:46 2022] POST /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:54:46.621371 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9d00e50f-882f-4794-ad3c-bbafe7dbf904 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:46.621988 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9d00e50f-882f-4794-ad3c-bbafe7dbf904 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:46.628696 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9d00e50f-882f-4794-ad3c-bbafe7dbf904 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.629172 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9d00e50f-882f-4794-ad3c-bbafe7dbf904 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.629950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9d00e50f-882f-4794-ad3c-bbafe7dbf904 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.630394 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9d00e50f-882f-4794-ad3c-bbafe7dbf904 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.772262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9d00e50f-882f-4794-ad3c-bbafe7dbf904 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:46.781777 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9d00e50f-882f-4794-ad3c-bbafe7dbf904 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1723 microversion: 2.1 time: 0.164367 Jul 18 16:54:46.783011 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 258/500] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:46 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:46.983908 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3e85b294-348d-4ae8-9693-d245a705911e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:46.984597 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3e85b294-348d-4ae8-9693-d245a705911e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:46.991330 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3e85b294-348d-4ae8-9693-d245a705911e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.991779 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3e85b294-348d-4ae8-9693-d245a705911e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.992540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3e85b294-348d-4ae8-9693-d245a705911e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.993076 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3e85b294-348d-4ae8-9693-d245a705911e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.121663 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-0f2392ae-e881-4a67-b59b-9f6c7480f5d2 req-4955c389-9905-4b6e-aa7e-ad73122a7344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69c45d3-ad0f-4135-9752-32f5baf001b2", "tag": "23638164-6355-4304-87f3-85c18f5e1916"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:47.133050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-0f2392ae-e881-4a67-b59b-9f6c7480f5d2 req-4955c389-9905-4b6e-aa7e-ad73122a7344 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.133511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-0f2392ae-e881-4a67-b59b-9f6c7480f5d2 req-4955c389-9905-4b6e-aa7e-ad73122a7344 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.146629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-0f2392ae-e881-4a67-b59b-9f6c7480f5d2 req-4955c389-9905-4b6e-aa7e-ad73122a7344 service nova] Creating event network-changed:23638164-6355-4304-87f3-85c18f5e1916 for instance f69c45d3-ad0f-4135-9752-32f5baf001b2 on hv-cinder-84617 Jul 18 16:54:47.151824 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-0f2392ae-e881-4a67-b59b-9f6c7480f5d2 req-4955c389-9905-4b6e-aa7e-ad73122a7344 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034945 Jul 18 16:54:47.152429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 259/501] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:47.205629 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3e85b294-348d-4ae8-9693-d245a705911e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:47.213663 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3e85b294-348d-4ae8-9693-d245a705911e tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.234082 Jul 18 16:54:47.219352 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 243/502] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:46 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:47.446146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bf35b412-23c2-4d37-9dd5-9d1716552969 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:47.446838 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bf35b412-23c2-4d37-9dd5-9d1716552969 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:47.454133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bf35b412-23c2-4d37-9dd5-9d1716552969 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.454588 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bf35b412-23c2-4d37-9dd5-9d1716552969 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.455382 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bf35b412-23c2-4d37-9dd5-9d1716552969 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.455794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bf35b412-23c2-4d37-9dd5-9d1716552969 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.603394 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-bf35b412-23c2-4d37-9dd5-9d1716552969 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:47.611047 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bf35b412-23c2-4d37-9dd5-9d1716552969 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.169112 Jul 18 16:54:47.611635 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 260/503] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:47 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:47.799714 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4daa816f-1abc-4f91-9271-a1ded8a1f736 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:47.800411 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4daa816f-1abc-4f91-9271-a1ded8a1f736 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:47.806918 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4daa816f-1abc-4f91-9271-a1ded8a1f736 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.807815 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4daa816f-1abc-4f91-9271-a1ded8a1f736 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.808300 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4daa816f-1abc-4f91-9271-a1ded8a1f736 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.808650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4daa816f-1abc-4f91-9271-a1ded8a1f736 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.139532 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4daa816f-1abc-4f91-9271-a1ded8a1f736 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:48.147505 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4daa816f-1abc-4f91-9271-a1ded8a1f736 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1723 microversion: 2.1 time: 0.351646 Jul 18 16:54:48.148077 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 244/504] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:47 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:48.230638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e0eae7b9-1943-4c08-9073-7a2f82a3897c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:48.231182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e0eae7b9-1943-4c08-9073-7a2f82a3897c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:48.238910 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e0eae7b9-1943-4c08-9073-7a2f82a3897c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.239355 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e0eae7b9-1943-4c08-9073-7a2f82a3897c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.240127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e0eae7b9-1943-4c08-9073-7a2f82a3897c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.240560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e0eae7b9-1943-4c08-9073-7a2f82a3897c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.377614 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e0eae7b9-1943-4c08-9073-7a2f82a3897c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:48.385073 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e0eae7b9-1943-4c08-9073-7a2f82a3897c tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.158430 Jul 18 16:54:48.385637 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 261/505] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:48 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:48.627649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-06865494-f6c8-4b95-8e27-ad1433e5944c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:48.628395 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-06865494-f6c8-4b95-8e27-ad1433e5944c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:48.630455 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:48.635168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-06865494-f6c8-4b95-8e27-ad1433e5944c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.636307 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-06865494-f6c8-4b95-8e27-ad1433e5944c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.636672 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-06865494-f6c8-4b95-8e27-ad1433e5944c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.637178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-06865494-f6c8-4b95-8e27-ad1433e5944c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.930175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-06865494-f6c8-4b95-8e27-ad1433e5944c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:48.930506 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:48.936953 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-06865494-f6c8-4b95-8e27-ad1433e5944c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.313112 Jul 18 16:54:48.940072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 245/506] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:48 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:49.165878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7d7556ed-b0e4-459e-9fa1-9910bc620e24 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:49.166562 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7d7556ed-b0e4-459e-9fa1-9910bc620e24 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:49.173165 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7d7556ed-b0e4-459e-9fa1-9910bc620e24 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.173621 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7d7556ed-b0e4-459e-9fa1-9910bc620e24 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.174401 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7d7556ed-b0e4-459e-9fa1-9910bc620e24 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.174840 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7d7556ed-b0e4-459e-9fa1-9910bc620e24 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.304582 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7d7556ed-b0e4-459e-9fa1-9910bc620e24 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:49.312780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7d7556ed-b0e4-459e-9fa1-9910bc620e24 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1723 microversion: 2.1 time: 0.151085 Jul 18 16:54:49.313385 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 262/507] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:49 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:49.402591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8604ba30-c97a-4312-8bb7-32eff0c97f87 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:49.403204 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8604ba30-c97a-4312-8bb7-32eff0c97f87 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:49.411294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8604ba30-c97a-4312-8bb7-32eff0c97f87 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.411755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8604ba30-c97a-4312-8bb7-32eff0c97f87 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.412607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8604ba30-c97a-4312-8bb7-32eff0c97f87 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.414145 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8604ba30-c97a-4312-8bb7-32eff0c97f87 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.561588 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8604ba30-c97a-4312-8bb7-32eff0c97f87 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:49.569094 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8604ba30-c97a-4312-8bb7-32eff0c97f87 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.171005 Jul 18 16:54:49.569856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 246/508] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:49 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:49.956090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4b6ac3e8-a234-4ee3-b936-6bd798bc51eb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:49.956485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4b6ac3e8-a234-4ee3-b936-6bd798bc51eb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:49.958537 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:49.962377 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=8 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:49.964287 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4b6ac3e8-a234-4ee3-b936-6bd798bc51eb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.964737 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4b6ac3e8-a234-4ee3-b936-6bd798bc51eb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.965548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4b6ac3e8-a234-4ee3-b936-6bd798bc51eb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:49.965987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4b6ac3e8-a234-4ee3-b936-6bd798bc51eb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.103531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4b6ac3e8-a234-4ee3-b936-6bd798bc51eb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:50.111878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4b6ac3e8-a234-4ee3-b936-6bd798bc51eb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.160719 Jul 18 16:54:50.112458 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 263/509] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:49 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:50.330076 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2ca61336-477c-43de-8957-22874c62a082 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:50.330683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2ca61336-477c-43de-8957-22874c62a082 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:50.337003 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2ca61336-477c-43de-8957-22874c62a082 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.337517 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2ca61336-477c-43de-8957-22874c62a082 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.338277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2ca61336-477c-43de-8957-22874c62a082 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.338750 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2ca61336-477c-43de-8957-22874c62a082 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.470444 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2ca61336-477c-43de-8957-22874c62a082 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:50.478939 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2ca61336-477c-43de-8957-22874c62a082 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1723 microversion: 2.1 time: 0.152969 Jul 18 16:54:50.479501 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 247/510] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:50 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:50.586513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f7de686a-e0ff-4483-94f0-462bd7830598 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:50.587028 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f7de686a-e0ff-4483-94f0-462bd7830598 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:50.594197 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7de686a-e0ff-4483-94f0-462bd7830598 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.594642 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7de686a-e0ff-4483-94f0-462bd7830598 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.595390 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7de686a-e0ff-4483-94f0-462bd7830598 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.595853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7de686a-e0ff-4483-94f0-462bd7830598 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.724120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f7de686a-e0ff-4483-94f0-462bd7830598 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:50.731675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f7de686a-e0ff-4483-94f0-462bd7830598 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.149248 Jul 18 16:54:50.732279 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 264/511] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:50 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:51.128732 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4378c9cc-8293-49d0-8bd0-20235b6e501c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:51.129370 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4378c9cc-8293-49d0-8bd0-20235b6e501c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:51.131204 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=8 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:51.136150 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4378c9cc-8293-49d0-8bd0-20235b6e501c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.136604 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4378c9cc-8293-49d0-8bd0-20235b6e501c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.137396 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4378c9cc-8293-49d0-8bd0-20235b6e501c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.137829 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4378c9cc-8293-49d0-8bd0-20235b6e501c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.273904 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4378c9cc-8293-49d0-8bd0-20235b6e501c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:51.282024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4378c9cc-8293-49d0-8bd0-20235b6e501c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.157240 Jul 18 16:54:51.283134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 248/512] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:51 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:51.496084 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-51e26d3a-18e0-406e-836a-3b3c20c9c705 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:51.496608 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-51e26d3a-18e0-406e-836a-3b3c20c9c705 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:51.503033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-51e26d3a-18e0-406e-836a-3b3c20c9c705 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.503488 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-51e26d3a-18e0-406e-836a-3b3c20c9c705 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.504286 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-51e26d3a-18e0-406e-836a-3b3c20c9c705 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.504723 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-51e26d3a-18e0-406e-836a-3b3c20c9c705 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.580953 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-84ba4942-a679-4bed-9a44-1522f702abfe req-68c5d758-cd02-41de-b316-4340d1686d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0010eb6-67ea-4a2a-8684-87247f78b6ce", "name": "network-vif-plugged", "status": "completed", "tag": "6c131419-d2f0-46b1-88f4-f0b44fbdd035"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:51.589785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-84ba4942-a679-4bed-9a44-1522f702abfe req-68c5d758-cd02-41de-b316-4340d1686d1b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.591194 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-84ba4942-a679-4bed-9a44-1522f702abfe req-68c5d758-cd02-41de-b316-4340d1686d1b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.603324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-84ba4942-a679-4bed-9a44-1522f702abfe req-68c5d758-cd02-41de-b316-4340d1686d1b service nova] Creating event network-vif-plugged:6c131419-d2f0-46b1-88f4-f0b44fbdd035 for instance c0010eb6-67ea-4a2a-8684-87247f78b6ce on hv-cinder-84617 Jul 18 16:54:51.609086 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-84ba4942-a679-4bed-9a44-1522f702abfe req-68c5d758-cd02-41de-b316-4340d1686d1b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033743 Jul 18 16:54:51.609695 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 249/513] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:54:51.651148 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-51e26d3a-18e0-406e-836a-3b3c20c9c705 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:51.659777 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-51e26d3a-18e0-406e-836a-3b3c20c9c705 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1729 microversion: 2.1 time: 0.167544 Jul 18 16:54:51.660585 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 265/514] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:51 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:51.693619 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0f66081f-2a5c-4d1f-bb88-b6a0b366ca74 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:51.694193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0f66081f-2a5c-4d1f-bb88-b6a0b366ca74 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:51.700634 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0f66081f-2a5c-4d1f-bb88-b6a0b366ca74 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.701112 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0f66081f-2a5c-4d1f-bb88-b6a0b366ca74 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.701882 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0f66081f-2a5c-4d1f-bb88-b6a0b366ca74 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.702501 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0f66081f-2a5c-4d1f-bb88-b6a0b366ca74 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.750327 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-fece3d3b-b39a-479e-abfb-a770d3e924f8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:51.751086 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-fece3d3b-b39a-479e-abfb-a770d3e924f8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:51.759381 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fece3d3b-b39a-479e-abfb-a770d3e924f8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.761245 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fece3d3b-b39a-479e-abfb-a770d3e924f8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.762772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fece3d3b-b39a-479e-abfb-a770d3e924f8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.763299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fece3d3b-b39a-479e-abfb-a770d3e924f8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.797883 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0f66081f-2a5c-4d1f-bb88-b6a0b366ca74 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108589 Jul 18 16:54:51.799183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 250/515] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 16:54:51 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:51.907457 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-fece3d3b-b39a-479e-abfb-a770d3e924f8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:51.914979 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-fece3d3b-b39a-479e-abfb-a770d3e924f8 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.169522 Jul 18 16:54:51.915559 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 266/516] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:51 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:52.298794 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c08275f1-e564-4ca1-8aa4-aabc1f1c3c86 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:52.299398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c08275f1-e564-4ca1-8aa4-aabc1f1c3c86 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:52.305984 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c08275f1-e564-4ca1-8aa4-aabc1f1c3c86 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.306434 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c08275f1-e564-4ca1-8aa4-aabc1f1c3c86 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.307230 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c08275f1-e564-4ca1-8aa4-aabc1f1c3c86 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.307672 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c08275f1-e564-4ca1-8aa4-aabc1f1c3c86 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.494828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c08275f1-e564-4ca1-8aa4-aabc1f1c3c86 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:52.503134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c08275f1-e564-4ca1-8aa4-aabc1f1c3c86 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.208277 Jul 18 16:54:52.503708 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 251/517] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:52 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:52.940219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8b11541b-486e-47b8-9b1d-5a6f83e37365 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:52.941293 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8b11541b-486e-47b8-9b1d-5a6f83e37365 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:52.947789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8b11541b-486e-47b8-9b1d-5a6f83e37365 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.947948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8b11541b-486e-47b8-9b1d-5a6f83e37365 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.948646 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8b11541b-486e-47b8-9b1d-5a6f83e37365 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.949111 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8b11541b-486e-47b8-9b1d-5a6f83e37365 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.080703 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8b11541b-486e-47b8-9b1d-5a6f83e37365 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:53.089330 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8b11541b-486e-47b8-9b1d-5a6f83e37365 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.155171 Jul 18 16:54:53.098874 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 267/518] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:52 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:53.138912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-6477246a-18d9-427d-b713-11d0a05d5666 req-ff943c2c-748e-4787-87ad-0705cec9de5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3504a1-341a-4a72-9cd1-0597e63ffa7d", "tag": "b2759155-87eb-4bd6-b4ea-81f112800de2"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:53.149029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-6477246a-18d9-427d-b713-11d0a05d5666 req-ff943c2c-748e-4787-87ad-0705cec9de5f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.149029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-6477246a-18d9-427d-b713-11d0a05d5666 req-ff943c2c-748e-4787-87ad-0705cec9de5f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.159632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-6477246a-18d9-427d-b713-11d0a05d5666 req-ff943c2c-748e-4787-87ad-0705cec9de5f service nova] Creating event network-changed:b2759155-87eb-4bd6-b4ea-81f112800de2 for instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d on hv-cinder-84617 Jul 18 16:54:53.164733 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-6477246a-18d9-427d-b713-11d0a05d5666 req-ff943c2c-748e-4787-87ad-0705cec9de5f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029719 Jul 18 16:54:53.165450 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 252/519] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:53.520109 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3f7c1597-5baf-41a7-afd2-7d0c4c59f2aa tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:53.520714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3f7c1597-5baf-41a7-afd2-7d0c4c59f2aa tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:53.526853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3f7c1597-5baf-41a7-afd2-7d0c4c59f2aa tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.527300 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3f7c1597-5baf-41a7-afd2-7d0c4c59f2aa tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.528063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3f7c1597-5baf-41a7-afd2-7d0c4c59f2aa tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.528499 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3f7c1597-5baf-41a7-afd2-7d0c4c59f2aa tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.671919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3f7c1597-5baf-41a7-afd2-7d0c4c59f2aa tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:53.679496 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3f7c1597-5baf-41a7-afd2-7d0c4c59f2aa tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.163164 Jul 18 16:54:53.680070 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 268/520] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:53 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:54.107638 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-16c7a5dc-6047-4604-9f44-ec7cecfb3887 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.108485 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-16c7a5dc-6047-4604-9f44-ec7cecfb3887 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.116215 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-16c7a5dc-6047-4604-9f44-ec7cecfb3887 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.116927 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-16c7a5dc-6047-4604-9f44-ec7cecfb3887 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.117711 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-16c7a5dc-6047-4604-9f44-ec7cecfb3887 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.118176 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-16c7a5dc-6047-4604-9f44-ec7cecfb3887 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.193730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5849130f-8960-4235-acaf-75e61ecaba1b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.194747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5849130f-8960-4235-acaf-75e61ecaba1b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.201913 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5849130f-8960-4235-acaf-75e61ecaba1b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.202367 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5849130f-8960-4235-acaf-75e61ecaba1b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.203146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5849130f-8960-4235-acaf-75e61ecaba1b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.203585 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5849130f-8960-4235-acaf-75e61ecaba1b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.236675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5849130f-8960-4235-acaf-75e61ecaba1b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046829 Jul 18 16:54:54.237658 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 269/521] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:54:54 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 16:54:54.302524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6dca710f-31c8-4fc1-8f11-304ba7aff81d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.303027 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6dca710f-31c8-4fc1-8f11-304ba7aff81d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.309228 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6dca710f-31c8-4fc1-8f11-304ba7aff81d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.309674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6dca710f-31c8-4fc1-8f11-304ba7aff81d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.310481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6dca710f-31c8-4fc1-8f11-304ba7aff81d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.310916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6dca710f-31c8-4fc1-8f11-304ba7aff81d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.316354 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:54.335470 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-16c7a5dc-6047-4604-9f44-ec7cecfb3887 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.340506 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6dca710f-31c8-4fc1-8f11-304ba7aff81d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:54:54.344809 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-16c7a5dc-6047-4604-9f44-ec7cecfb3887 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1318 microversion: 2.1 time: 0.242151 Jul 18 16:54:54.347233 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 253/522] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:54 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:54.697522 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-55e4ac83-3c71-4110-86c9-be7b21718aae tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.697875 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6dca710f-31c8-4fc1-8f11-304ba7aff81d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 204 len: 0 microversion: 2.1 time: 0.398943 Jul 18 16:54:54.698053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-55e4ac83-3c71-4110-86c9-be7b21718aae tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.698462 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 270/523] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:54:54 2022] DELETE /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:54:54.705042 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-55e4ac83-3c71-4110-86c9-be7b21718aae tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.705493 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-55e4ac83-3c71-4110-86c9-be7b21718aae tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.706337 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-55e4ac83-3c71-4110-86c9-be7b21718aae tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.706781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-55e4ac83-3c71-4110-86c9-be7b21718aae tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.707886 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6444a32f-ac7f-41e2-b6ae-6e48a6910814 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.708584 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6444a32f-ac7f-41e2-b6ae-6e48a6910814 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.714937 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6444a32f-ac7f-41e2-b6ae-6e48a6910814 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.715405 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6444a32f-ac7f-41e2-b6ae-6e48a6910814 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.716172 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6444a32f-ac7f-41e2-b6ae-6e48a6910814 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.717258 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6444a32f-ac7f-41e2-b6ae-6e48a6910814 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.845596 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-55e4ac83-3c71-4110-86c9-be7b21718aae tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.848057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6444a32f-ac7f-41e2-b6ae-6e48a6910814 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.853237 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-55e4ac83-3c71-4110-86c9-be7b21718aae tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.159812 Jul 18 16:54:54.853817 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 254/524] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:54 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:54.855711 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6444a32f-ac7f-41e2-b6ae-6e48a6910814 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1673 microversion: 2.1 time: 0.152258 Jul 18 16:54:54.856272 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 271/525] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:54 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:55.180092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-85224862-e44b-4485-9bc1-9206e20c72e4 req-fc7f6842-1435-400d-98bb-67f7e3b7e22c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3504a1-341a-4a72-9cd1-0597e63ffa7d", "tag": "b2759155-87eb-4bd6-b4ea-81f112800de2"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:55.189879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-85224862-e44b-4485-9bc1-9206e20c72e4 req-fc7f6842-1435-400d-98bb-67f7e3b7e22c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.190323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-85224862-e44b-4485-9bc1-9206e20c72e4 req-fc7f6842-1435-400d-98bb-67f7e3b7e22c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.201906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-85224862-e44b-4485-9bc1-9206e20c72e4 req-fc7f6842-1435-400d-98bb-67f7e3b7e22c service nova] Creating event network-changed:b2759155-87eb-4bd6-b4ea-81f112800de2 for instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d on hv-cinder-84617 Jul 18 16:54:55.206950 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-85224862-e44b-4485-9bc1-9206e20c72e4 req-fc7f6842-1435-400d-98bb-67f7e3b7e22c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030500 Jul 18 16:54:55.207541 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 255/526] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:55.363233 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2f7be6df-f323-4809-9d4e-d1f8577b7c02 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:55.363859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2f7be6df-f323-4809-9d4e-d1f8577b7c02 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:55.370454 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f7be6df-f323-4809-9d4e-d1f8577b7c02 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.370910 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f7be6df-f323-4809-9d4e-d1f8577b7c02 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.371681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f7be6df-f323-4809-9d4e-d1f8577b7c02 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.372123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f7be6df-f323-4809-9d4e-d1f8577b7c02 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.502580 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2f7be6df-f323-4809-9d4e-d1f8577b7c02 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:55.510468 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2f7be6df-f323-4809-9d4e-d1f8577b7c02 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1507 microversion: 2.1 time: 0.151035 Jul 18 16:54:55.511057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 272/527] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:55 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:55.531183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-be571d02-0c7a-4e3a-b739-786d46134e24 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d820296-3f43-4106-93b9-b0f2a14019f2", "device": "/dev/sdb"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:54:55.532823 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-be571d02-0c7a-4e3a-b739-786d46134e24 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:55.539039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-be571d02-0c7a-4e3a-b739-786d46134e24 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.539479 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-be571d02-0c7a-4e3a-b739-786d46134e24 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.540240 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-be571d02-0c7a-4e3a-b739-786d46134e24 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.540674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-be571d02-0c7a-4e3a-b739-786d46134e24 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.871178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-376ca35b-4838-4699-be94-c20d4ba5edbb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:55.871789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-376ca35b-4838-4699-be94-c20d4ba5edbb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:55.878459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-376ca35b-4838-4699-be94-c20d4ba5edbb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.878952 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-376ca35b-4838-4699-be94-c20d4ba5edbb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.879710 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-376ca35b-4838-4699-be94-c20d4ba5edbb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.880178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-376ca35b-4838-4699-be94-c20d4ba5edbb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.012958 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-376ca35b-4838-4699-be94-c20d4ba5edbb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:56.020968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-376ca35b-4838-4699-be94-c20d4ba5edbb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.153835 Jul 18 16:54:56.021532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 273/528] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:55 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:56.025907 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d4e11eea-c1bd-46ae-9b8c-ec3bb1374a77 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:56.026540 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d4e11eea-c1bd-46ae-9b8c-ec3bb1374a77 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:56.032187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d4e11eea-c1bd-46ae-9b8c-ec3bb1374a77 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.032665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d4e11eea-c1bd-46ae-9b8c-ec3bb1374a77 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.033456 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d4e11eea-c1bd-46ae-9b8c-ec3bb1374a77 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:56.033941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d4e11eea-c1bd-46ae-9b8c-ec3bb1374a77 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.163919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d4e11eea-c1bd-46ae-9b8c-ec3bb1374a77 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:56.171992 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d4e11eea-c1bd-46ae-9b8c-ec3bb1374a77 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1673 microversion: 2.1 time: 0.149395 Jul 18 16:54:56.172595 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 274/529] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:56 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:57.037831 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4c430a64-2316-4556-a428-57a4dafa4381 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:57.038477 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4c430a64-2316-4556-a428-57a4dafa4381 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:57.045330 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4c430a64-2316-4556-a428-57a4dafa4381 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.045775 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4c430a64-2316-4556-a428-57a4dafa4381 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.046532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4c430a64-2316-4556-a428-57a4dafa4381 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.046961 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4c430a64-2316-4556-a428-57a4dafa4381 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.400731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4c430a64-2316-4556-a428-57a4dafa4381 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:57.409037 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4c430a64-2316-4556-a428-57a4dafa4381 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.375055 Jul 18 16:54:57.409630 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 275/530] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:57 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:57.414184 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a90250c8-7de9-434a-8557-be19c7d3e8ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:57.414792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a90250c8-7de9-434a-8557-be19c7d3e8ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:57.426505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a90250c8-7de9-434a-8557-be19c7d3e8ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.429422 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a90250c8-7de9-434a-8557-be19c7d3e8ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.429422 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a90250c8-7de9-434a-8557-be19c7d3e8ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.429422 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a90250c8-7de9-434a-8557-be19c7d3e8ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.559237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a90250c8-7de9-434a-8557-be19c7d3e8ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:57.567206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a90250c8-7de9-434a-8557-be19c7d3e8ba tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1673 microversion: 2.1 time: 0.156602 Jul 18 16:54:57.567841 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 276/531] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:57 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:58.432600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-368754f8-3ff1-44df-bb9d-78f576c599e2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:58.433358 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-368754f8-3ff1-44df-bb9d-78f576c599e2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:58.441596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-368754f8-3ff1-44df-bb9d-78f576c599e2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.442155 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-368754f8-3ff1-44df-bb9d-78f576c599e2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.443004 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-368754f8-3ff1-44df-bb9d-78f576c599e2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.443544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-368754f8-3ff1-44df-bb9d-78f576c599e2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.647310 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-368754f8-3ff1-44df-bb9d-78f576c599e2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:58.655717 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-368754f8-3ff1-44df-bb9d-78f576c599e2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.226957 Jul 18 16:54:58.656304 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 277/532] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:58 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:58.661396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-47b9fd35-2814-44ef-b608-d88e9d436865 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:58.665739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-47b9fd35-2814-44ef-b608-d88e9d436865 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:58.669379 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-47b9fd35-2814-44ef-b608-d88e9d436865 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.669379 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-47b9fd35-2814-44ef-b608-d88e9d436865 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.669867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-47b9fd35-2814-44ef-b608-d88e9d436865 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.670469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-47b9fd35-2814-44ef-b608-d88e9d436865 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.809902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-47b9fd35-2814-44ef-b608-d88e9d436865 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:58.818126 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-47b9fd35-2814-44ef-b608-d88e9d436865 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1673 microversion: 2.1 time: 0.160445 Jul 18 16:54:58.818700 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 278/533] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:58 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:59.198894 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-be571d02-0c7a-4e3a-b739-786d46134e24 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "POST /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.671840 Jul 18 16:54:59.199811 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 256/534] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:54:55 2022] POST /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce/os-volume_attachments => generated 194 bytes in 3674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:54:59.674530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-eca7fb8c-566e-4365-9bae-23918f699ece tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:59.675625 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-eca7fb8c-566e-4365-9bae-23918f699ece tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:59.682750 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eca7fb8c-566e-4365-9bae-23918f699ece tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.683500 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eca7fb8c-566e-4365-9bae-23918f699ece tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.684280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eca7fb8c-566e-4365-9bae-23918f699ece tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.685844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eca7fb8c-566e-4365-9bae-23918f699ece tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.837638 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9e3e0553-a565-48c3-a860-c5d29e54d16e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:59.838337 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9e3e0553-a565-48c3-a860-c5d29e54d16e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:59.839211 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-eca7fb8c-566e-4365-9bae-23918f699ece tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:59.849452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-eca7fb8c-566e-4365-9bae-23918f699ece tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.179467 Jul 18 16:54:59.850463 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 279/535] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:59 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:59.856191 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9e3e0553-a565-48c3-a860-c5d29e54d16e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.857624 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9e3e0553-a565-48c3-a860-c5d29e54d16e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.858641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9e3e0553-a565-48c3-a860-c5d29e54d16e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.859283 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9e3e0553-a565-48c3-a860-c5d29e54d16e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.064499 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9e3e0553-a565-48c3-a860-c5d29e54d16e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:00.073294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9e3e0553-a565-48c3-a860-c5d29e54d16e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1606 microversion: 2.1 time: 0.240430 Jul 18 16:55:00.074346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 257/536] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:59 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1606 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:00.280862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-4c37bf3a-0572-4e42-833c-7dad4fbb2d3e req-9e57c86d-87ac-41e3-9eae-545a8896365d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67187e3-9b84-4393-a7bf-c15db8b715ee", "name": "network-vif-deleted", "tag": "52949cd4-aff2-4ec9-8946-76ec43bfca3e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:00.292182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-4c37bf3a-0572-4e42-833c-7dad4fbb2d3e req-9e57c86d-87ac-41e3-9eae-545a8896365d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.292559 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-4c37bf3a-0572-4e42-833c-7dad4fbb2d3e req-9e57c86d-87ac-41e3-9eae-545a8896365d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.313823 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-4c37bf3a-0572-4e42-833c-7dad4fbb2d3e req-9e57c86d-87ac-41e3-9eae-545a8896365d service nova] Creating event network-vif-deleted:52949cd4-aff2-4ec9-8946-76ec43bfca3e for instance e67187e3-9b84-4393-a7bf-c15db8b715ee on hv-cinder-84617 Jul 18 16:55:00.333864 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-4c37bf3a-0572-4e42-833c-7dad4fbb2d3e req-9e57c86d-87ac-41e3-9eae-545a8896365d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051538 Jul 18 16:55:00.336646 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 280/537] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:00.870856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-88a5d1e8-585a-4e8a-99bb-fac889a95818 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:00.871644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-88a5d1e8-585a-4e8a-99bb-fac889a95818 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:00.880563 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-88a5d1e8-585a-4e8a-99bb-fac889a95818 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.881315 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-88a5d1e8-585a-4e8a-99bb-fac889a95818 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.882152 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-88a5d1e8-585a-4e8a-99bb-fac889a95818 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.882764 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-88a5d1e8-585a-4e8a-99bb-fac889a95818 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.062530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-88a5d1e8-585a-4e8a-99bb-fac889a95818 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:01.075122 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-88a5d1e8-585a-4e8a-99bb-fac889a95818 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.209003 Jul 18 16:55:01.076027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 258/538] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:00 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:01.094270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:01.095687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:01.102641 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.107484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.107484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.107484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.146987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.147597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.148169 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lazy-loading 'fault' on Instance uuid e67187e3-9b84-4393-a7bf-c15db8b715ee {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:55:01.197841 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:01.208467 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e81a98ff-ac6d-438e-bcc5-618227231fc9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 200 len: 1328 microversion: 2.1 time: 0.120444 Jul 18 16:55:01.209097 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 281/539] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:01 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 1328 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:01.686228 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-62c18b89-8971-4fbc-9f65-f8f13b719ac0 req-000c3932-cbff-4d1d-a900-e8dd42b95e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69c45d3-ad0f-4135-9752-32f5baf001b2", "name": "network-vif-plugged", "status": "completed", "tag": "23638164-6355-4304-87f3-85c18f5e1916"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:01.698118 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-62c18b89-8971-4fbc-9f65-f8f13b719ac0 req-000c3932-cbff-4d1d-a900-e8dd42b95e5c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.698562 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-62c18b89-8971-4fbc-9f65-f8f13b719ac0 req-000c3932-cbff-4d1d-a900-e8dd42b95e5c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.712028 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-62c18b89-8971-4fbc-9f65-f8f13b719ac0 req-000c3932-cbff-4d1d-a900-e8dd42b95e5c service nova] Creating event network-vif-plugged:23638164-6355-4304-87f3-85c18f5e1916 for instance f69c45d3-ad0f-4135-9752-32f5baf001b2 on hv-cinder-84617 Jul 18 16:55:01.717275 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-62c18b89-8971-4fbc-9f65-f8f13b719ac0 req-000c3932-cbff-4d1d-a900-e8dd42b95e5c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Jul 18 16:55:01.718287 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 259/540] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:02.092700 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-110bf9e6-03ff-4777-9083-a4405c09f7d2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:02.093337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-110bf9e6-03ff-4777-9083-a4405c09f7d2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:02.095938 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:02.100731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-110bf9e6-03ff-4777-9083-a4405c09f7d2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:02.101223 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-110bf9e6-03ff-4777-9083-a4405c09f7d2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.102013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-110bf9e6-03ff-4777-9083-a4405c09f7d2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:02.102449 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-110bf9e6-03ff-4777-9083-a4405c09f7d2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.227095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:02.232434 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:02.237137 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:02.237702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.239380 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:02.239900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.244640 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-110bf9e6-03ff-4777-9083-a4405c09f7d2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:02.254704 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] HTTP exception thrown: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Request method failure captured: Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee HTTP/1.1 Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y9ElSq7L7dhSD5K40Y3KQ_wF7s8ffRQq3Uwf4NLohJOtjrYUbZvJYfE9whfF-VWno5XjrwKglgJrr9IJv0B15Wy99Jg_6h1TczpXAUGbgNdVOUKoeOXZjZRIDhKK7UlbKG7D0wb5zyI2z-Gh-70ocZlKiUe14uEP-0jJ49Ggsm3ceo Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:55:02.256487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e8bca7eae3a348069131e97b048412b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}] Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 6890f2e62cfd46999791d4a10a81f95c Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:55:02.258218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': 'e67187e3-9b84-4393-a7bf-c15db8b715ee'} Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:55:02.259205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:55:02.260872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:02.262210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Returning 404 to user: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:55:02.262298 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-110bf9e6-03ff-4777-9083-a4405c09f7d2 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.170822 Jul 18 16:55:02.262298 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 282/541] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:02 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:02.270155 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d0424725-8673-49d5-900e-68bff72afb23 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 404 len: 111 microversion: 2.1 time: 0.046977 Jul 18 16:55:02.270704 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 260/542] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:02 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:55:02.279934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-aaadd885-5c0c-4e32-bd20-60ee781d82fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '.version_select at 0x7fd4f5265280>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:02.389213 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-aaadd885-5c0c-4e32-bd20-60ee781d82fd tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188601585" status: 202 len: 0 microversion: 2.1 time: 0.112971 Jul 18 16:55:02.389812 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 283/543] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 16:55:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188601585 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:55:03.255119 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-448a1dae-ca54-4a85-ac81-a334279bf792 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'create', calling method: .version_select at 0x7fd4f513b9d0>, body: {"keypair": {"name": "tempest-keypair-24595641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRGKIcb0ld/AX5T1Sxhr+A7JzyLjdVnjUoJTswqGyj4O7TAjDFcRnqFq8kQCVl1gMylHRenOse6oS8VV+AVaVEBDuVmlH3ubkJeCQCmVcG9+mgHjTHxKQbba938ZWFsqQ=="}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:03.269671 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-448a1dae-ca54-4a85-ac81-a334279bf792 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Getting quotas for project e8bca7eae3a348069131e97b048412b5. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:55:03.273627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-448a1dae-ca54-4a85-ac81-a334279bf792 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Getting quotas for user 6890f2e62cfd46999791d4a10a81f95c and project e8bca7eae3a348069131e97b048412b5. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:55:03.277527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2f5fdc8a-b1d2-4080-8aeb-316bb5afb03a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:03.278246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2f5fdc8a-b1d2-4080-8aeb-316bb5afb03a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:03.285003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f5fdc8a-b1d2-4080-8aeb-316bb5afb03a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:03.285469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f5fdc8a-b1d2-4080-8aeb-316bb5afb03a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:03.286945 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f5fdc8a-b1d2-4080-8aeb-316bb5afb03a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:03.287395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2f5fdc8a-b1d2-4080-8aeb-316bb5afb03a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:03.359815 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-448a1dae-ca54-4a85-ac81-a334279bf792 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.108569 Jul 18 16:55:03.360431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 261/544] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:55:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:03.436270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2f5fdc8a-b1d2-4080-8aeb-316bb5afb03a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:03.444049 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2f5fdc8a-b1d2-4080-8aeb-316bb5afb03a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1264 microversion: 2.1 time: 0.171022 Jul 18 16:55:03.445701 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 284/545] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:03 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:04.461431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c075a624-0c22-40de-9f4d-aff8c7bad73a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:04.462132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c075a624-0c22-40de-9f4d-aff8c7bad73a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:04.470339 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c075a624-0c22-40de-9f4d-aff8c7bad73a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.470783 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c075a624-0c22-40de-9f4d-aff8c7bad73a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.471593 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c075a624-0c22-40de-9f4d-aff8c7bad73a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.472021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c075a624-0c22-40de-9f4d-aff8c7bad73a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.697550 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c075a624-0c22-40de-9f4d-aff8c7bad73a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:04.706366 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c075a624-0c22-40de-9f4d-aff8c7bad73a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1451 microversion: 2.1 time: 0.249328 Jul 18 16:55:04.717002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 262/546] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:04 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1451 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:04.727482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b00793fb-5913-4d37-86ea-18464993648b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:04.728097 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b00793fb-5913-4d37-86ea-18464993648b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:04.734707 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b00793fb-5913-4d37-86ea-18464993648b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.735157 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b00793fb-5913-4d37-86ea-18464993648b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.735939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b00793fb-5913-4d37-86ea-18464993648b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.736381 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b00793fb-5913-4d37-86ea-18464993648b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.871805 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b00793fb-5913-4d37-86ea-18464993648b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:04.880054 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b00793fb-5913-4d37-86ea-18464993648b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1451 microversion: 2.1 time: 0.156488 Jul 18 16:55:04.882571 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 285/547] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:04 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:05.753675 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1478713182", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0dd368f-243f-48b8-8894-e198d646cac0"}], "security_groups": [{"name": "tempest-securitygroup--131000693"}], "key_name": "tempest-keypair-24595641", "user_data": "}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:05.861233 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] validate_networks() for [('e0dd368f-243f-48b8-8894-e198d646cac0', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:55:06.243261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:55:06.243261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:55:06.243261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:55:06.243261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:55:06.243261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:55:06.243757 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:06.251635 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.252074 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.252869 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.253333 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.270514 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Getting quotas for project e8bca7eae3a348069131e97b048412b5. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:55:06.274483 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Getting quotas for user 6890f2e62cfd46999791d4a10a81f95c and project e8bca7eae3a348069131e97b048412b5. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:55:06.286393 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:55:06.288646 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:55:06.422217 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c315649f-97cf-4759-aedf-d9a1d603f38c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.672760 Jul 18 16:55:06.423965 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 263/548] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:55:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:55:06.434666 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a4fc1498-7238-4af1-a647-322f66907320 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:06.435358 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a4fc1498-7238-4af1-a647-322f66907320 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:06.503725 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a4fc1498-7238-4af1-a647-322f66907320 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:06.511444 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a4fc1498-7238-4af1-a647-322f66907320 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1236 microversion: 2.1 time: 0.080644 Jul 18 16:55:06.512562 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 286/549] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:06 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:06.974371 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-c68ee132-a9ff-4673-a701-1a0c71a4c7ab req-d30198f5-b1db-4491-b293-7e3e340c320d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69c45d3-ad0f-4135-9752-32f5baf001b2", "tag": "23638164-6355-4304-87f3-85c18f5e1916"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:06.984118 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-c68ee132-a9ff-4673-a701-1a0c71a4c7ab req-d30198f5-b1db-4491-b293-7e3e340c320d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.985190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-c68ee132-a9ff-4673-a701-1a0c71a4c7ab req-d30198f5-b1db-4491-b293-7e3e340c320d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.999988 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-c68ee132-a9ff-4673-a701-1a0c71a4c7ab req-d30198f5-b1db-4491-b293-7e3e340c320d service nova] Creating event network-changed:23638164-6355-4304-87f3-85c18f5e1916 for instance f69c45d3-ad0f-4135-9752-32f5baf001b2 on hv-cinder-84617 Jul 18 16:55:07.009425 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-c68ee132-a9ff-4673-a701-1a0c71a4c7ab req-d30198f5-b1db-4491-b293-7e3e340c320d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037865 Jul 18 16:55:07.009425 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 264/550] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:07.530121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e3df0737-848d-417c-a211-463287d0091a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:07.531674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e3df0737-848d-417c-a211-463287d0091a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:07.544455 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e3df0737-848d-417c-a211-463287d0091a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:07.545461 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e3df0737-848d-417c-a211-463287d0091a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:07.546369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e3df0737-848d-417c-a211-463287d0091a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:07.546977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e3df0737-848d-417c-a211-463287d0091a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:07.568450 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:07.621988 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e3df0737-848d-417c-a211-463287d0091a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:07.635602 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e3df0737-848d-417c-a211-463287d0091a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1240 microversion: 2.1 time: 0.109344 Jul 18 16:55:07.637138 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 287/551] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:07 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:08.655109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-83914d82-73aa-4fa7-94e6-0c100bbe2312 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:08.655806 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-83914d82-73aa-4fa7-94e6-0c100bbe2312 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:08.663804 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-83914d82-73aa-4fa7-94e6-0c100bbe2312 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:08.664249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-83914d82-73aa-4fa7-94e6-0c100bbe2312 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:08.665065 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-83914d82-73aa-4fa7-94e6-0c100bbe2312 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:08.665486 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-83914d82-73aa-4fa7-94e6-0c100bbe2312 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:08.736252 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-83914d82-73aa-4fa7-94e6-0c100bbe2312 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:08.743877 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-83914d82-73aa-4fa7-94e6-0c100bbe2312 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1288 microversion: 2.1 time: 0.093627 Jul 18 16:55:08.744781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 265/552] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:08 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:08.865399 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-79a2deac-28b8-4c24-814c-1ccfc4e7af20 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:08.866351 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-79a2deac-28b8-4c24-814c-1ccfc4e7af20 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:08.873557 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-79a2deac-28b8-4c24-814c-1ccfc4e7af20 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:08.874076 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-79a2deac-28b8-4c24-814c-1ccfc4e7af20 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:08.874842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-79a2deac-28b8-4c24-814c-1ccfc4e7af20 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:08.875280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-79a2deac-28b8-4c24-814c-1ccfc4e7af20 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.098896 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-79a2deac-28b8-4c24-814c-1ccfc4e7af20 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "POST /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/action" status: 202 len: 0 microversion: 2.1 time: 0.237657 Jul 18 16:55:09.099567 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 288/553] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:55:08 2022] POST /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:55:09.107698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fff24309-99ff-4ae1-8957-0b15c1a34af3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:09.108301 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fff24309-99ff-4ae1-8957-0b15c1a34af3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:09.114365 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fff24309-99ff-4ae1-8957-0b15c1a34af3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.114821 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fff24309-99ff-4ae1-8957-0b15c1a34af3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.115611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fff24309-99ff-4ae1-8957-0b15c1a34af3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.116041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fff24309-99ff-4ae1-8957-0b15c1a34af3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.259242 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-fff24309-99ff-4ae1-8957-0b15c1a34af3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:09.267221 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fff24309-99ff-4ae1-8957-0b15c1a34af3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1750 microversion: 2.1 time: 0.163354 Jul 18 16:55:09.268056 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 266/554] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:09 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:09.764137 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6c248251-85fa-44eb-8c57-de27b8ce9c5b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:09.764837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6c248251-85fa-44eb-8c57-de27b8ce9c5b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:09.771139 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6c248251-85fa-44eb-8c57-de27b8ce9c5b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.771595 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6c248251-85fa-44eb-8c57-de27b8ce9c5b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.772682 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6c248251-85fa-44eb-8c57-de27b8ce9c5b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.773156 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6c248251-85fa-44eb-8c57-de27b8ce9c5b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.839928 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6c248251-85fa-44eb-8c57-de27b8ce9c5b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:09.847453 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6c248251-85fa-44eb-8c57-de27b8ce9c5b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1296 microversion: 2.1 time: 0.088182 Jul 18 16:55:09.848028 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 289/555] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:09 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:10.285593 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6d9a4a61-d783-4898-9d19-019765994163 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:10.286208 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6d9a4a61-d783-4898-9d19-019765994163 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:10.293218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d9a4a61-d783-4898-9d19-019765994163 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.293925 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d9a4a61-d783-4898-9d19-019765994163 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.294502 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d9a4a61-d783-4898-9d19-019765994163 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.294942 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d9a4a61-d783-4898-9d19-019765994163 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.299499 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:10.443856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6d9a4a61-d783-4898-9d19-019765994163 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:10.452263 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6d9a4a61-d783-4898-9d19-019765994163 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1750 microversion: 2.1 time: 0.171434 Jul 18 16:55:10.452844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 267/556] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:10 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:10.864905 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-200e5c46-c15c-464b-8203-86d5fd177f44 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:10.865540 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-200e5c46-c15c-464b-8203-86d5fd177f44 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:10.872203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-200e5c46-c15c-464b-8203-86d5fd177f44 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.872663 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-200e5c46-c15c-464b-8203-86d5fd177f44 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.873485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-200e5c46-c15c-464b-8203-86d5fd177f44 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.873934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-200e5c46-c15c-464b-8203-86d5fd177f44 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.935243 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-200e5c46-c15c-464b-8203-86d5fd177f44 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:10.942892 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-200e5c46-c15c-464b-8203-86d5fd177f44 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1296 microversion: 2.1 time: 0.081804 Jul 18 16:55:10.943465 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 290/557] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:10 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:11.470671 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6fbcd5d8-dafd-4877-847e-8011cf23aea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:11.471306 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6fbcd5d8-dafd-4877-847e-8011cf23aea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:11.478317 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6fbcd5d8-dafd-4877-847e-8011cf23aea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.478769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6fbcd5d8-dafd-4877-847e-8011cf23aea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:11.479535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6fbcd5d8-dafd-4877-847e-8011cf23aea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.479973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6fbcd5d8-dafd-4877-847e-8011cf23aea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:11.623635 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6fbcd5d8-dafd-4877-847e-8011cf23aea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:11.631774 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6fbcd5d8-dafd-4877-847e-8011cf23aea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1750 microversion: 2.1 time: 0.164971 Jul 18 16:55:11.632393 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 268/558] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:11 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:11.960020 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-87fdf1dc-c1ef-466e-a24e-c3890169c8b7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:11.960636 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-87fdf1dc-c1ef-466e-a24e-c3890169c8b7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:11.967873 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-87fdf1dc-c1ef-466e-a24e-c3890169c8b7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.968356 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-87fdf1dc-c1ef-466e-a24e-c3890169c8b7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:11.969134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-87fdf1dc-c1ef-466e-a24e-c3890169c8b7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.969575 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-87fdf1dc-c1ef-466e-a24e-c3890169c8b7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:12.032868 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-87fdf1dc-c1ef-466e-a24e-c3890169c8b7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:12.041967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-87fdf1dc-c1ef-466e-a24e-c3890169c8b7 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1306 microversion: 2.1 time: 0.085836 Jul 18 16:55:12.043494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 291/559] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:11 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:12.648911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-96a19221-26a1-4792-a9d1-b09db67e71e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:12.651157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-96a19221-26a1-4792-a9d1-b09db67e71e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:12.658994 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-96a19221-26a1-4792-a9d1-b09db67e71e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:12.659594 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-96a19221-26a1-4792-a9d1-b09db67e71e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:12.660693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-96a19221-26a1-4792-a9d1-b09db67e71e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:12.661235 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-96a19221-26a1-4792-a9d1-b09db67e71e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:13.096771 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-96a19221-26a1-4792-a9d1-b09db67e71e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:13.105406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-96a19221-26a1-4792-a9d1-b09db67e71e3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1750 microversion: 2.1 time: 0.460491 Jul 18 16:55:13.106609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 269/560] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:12 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1750 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:13.120903 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9449d120-b5f5-4e19-ac00-dcdb1e8306e5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:13.121521 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9449d120-b5f5-4e19-ac00-dcdb1e8306e5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:13.129295 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9449d120-b5f5-4e19-ac00-dcdb1e8306e5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:13.130734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9449d120-b5f5-4e19-ac00-dcdb1e8306e5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:13.130734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9449d120-b5f5-4e19-ac00-dcdb1e8306e5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:13.131010 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9449d120-b5f5-4e19-ac00-dcdb1e8306e5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:13.282834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9449d120-b5f5-4e19-ac00-dcdb1e8306e5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:13.290792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9449d120-b5f5-4e19-ac00-dcdb1e8306e5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.234922 Jul 18 16:55:13.291917 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 292/561] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:13 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:14.123643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a75ae6d9-2c2b-4863-b82c-04bd8bf1b094 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:14.124253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a75ae6d9-2c2b-4863-b82c-04bd8bf1b094 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:14.130836 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a75ae6d9-2c2b-4863-b82c-04bd8bf1b094 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:14.131285 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a75ae6d9-2c2b-4863-b82c-04bd8bf1b094 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.132122 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a75ae6d9-2c2b-4863-b82c-04bd8bf1b094 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:14.132556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a75ae6d9-2c2b-4863-b82c-04bd8bf1b094 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.291408 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a75ae6d9-2c2b-4863-b82c-04bd8bf1b094 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:14.300497 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a75ae6d9-2c2b-4863-b82c-04bd8bf1b094 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1750 microversion: 2.1 time: 0.181280 Jul 18 16:55:14.301116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 270/562] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:14 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:14.309050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-df1b17bf-19a1-4dea-b7b5-c5cc1eae90ae tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:14.310388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-df1b17bf-19a1-4dea-b7b5-c5cc1eae90ae tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:14.317921 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-df1b17bf-19a1-4dea-b7b5-c5cc1eae90ae tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:14.318369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-df1b17bf-19a1-4dea-b7b5-c5cc1eae90ae tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.319139 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-df1b17bf-19a1-4dea-b7b5-c5cc1eae90ae tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:14.319573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-df1b17bf-19a1-4dea-b7b5-c5cc1eae90ae tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.457851 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-df1b17bf-19a1-4dea-b7b5-c5cc1eae90ae tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:14.465662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-df1b17bf-19a1-4dea-b7b5-c5cc1eae90ae tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.160368 Jul 18 16:55:14.466702 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 293/563] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:14 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:15.318346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fd60e8c4-7ef9-4ab5-b145-77143818cef3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:15.319020 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fd60e8c4-7ef9-4ab5-b145-77143818cef3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:15.325523 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fd60e8c4-7ef9-4ab5-b145-77143818cef3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:15.325987 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fd60e8c4-7ef9-4ab5-b145-77143818cef3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:15.326752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fd60e8c4-7ef9-4ab5-b145-77143818cef3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:15.327187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fd60e8c4-7ef9-4ab5-b145-77143818cef3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:15.471612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-fd60e8c4-7ef9-4ab5-b145-77143818cef3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:15.480360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fd60e8c4-7ef9-4ab5-b145-77143818cef3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1750 microversion: 2.1 time: 0.165895 Jul 18 16:55:15.480958 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 271/564] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:15 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:15.483340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-55cf792c-e93b-44d5-9727-d9366253625b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:15.483946 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-55cf792c-e93b-44d5-9727-d9366253625b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:15.491037 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-55cf792c-e93b-44d5-9727-d9366253625b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:15.491488 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-55cf792c-e93b-44d5-9727-d9366253625b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:15.492289 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-55cf792c-e93b-44d5-9727-d9366253625b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:15.492709 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-55cf792c-e93b-44d5-9727-d9366253625b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:15.622768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-55cf792c-e93b-44d5-9727-d9366253625b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:15.630105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-55cf792c-e93b-44d5-9727-d9366253625b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.151246 Jul 18 16:55:15.630677 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 294/565] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:15 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:16.495171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:16.495789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=10 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:16.500071 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2799292c-d887-4508-a5e2-f5b98a8a9c8d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:16.500790 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2799292c-d887-4508-a5e2-f5b98a8a9c8d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:16.506752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2799292c-d887-4508-a5e2-f5b98a8a9c8d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.507203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2799292c-d887-4508-a5e2-f5b98a8a9c8d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.507977 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2799292c-d887-4508-a5e2-f5b98a8a9c8d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.508412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2799292c-d887-4508-a5e2-f5b98a8a9c8d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.647302 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-65efcb94-b7b3-47d1-bcb8-0e1070ee550a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:16.647963 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-65efcb94-b7b3-47d1-bcb8-0e1070ee550a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:16.651789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:16.656024 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-65efcb94-b7b3-47d1-bcb8-0e1070ee550a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.656484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-65efcb94-b7b3-47d1-bcb8-0e1070ee550a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.657294 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-65efcb94-b7b3-47d1-bcb8-0e1070ee550a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.657738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-65efcb94-b7b3-47d1-bcb8-0e1070ee550a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.688928 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2799292c-d887-4508-a5e2-f5b98a8a9c8d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:16.697316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2799292c-d887-4508-a5e2-f5b98a8a9c8d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.203195 Jul 18 16:55:16.698313 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 272/566] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:16 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:16.773000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-91132b33-ee18-4d56-821c-5b8630ea0d02 req-6184d20e-840a-416e-923f-eb5f89e344b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886b14f7-f670-4e46-b25f-1fd2502c5fce", "tag": "c8f5dcd2-0154-47c8-a079-036b5cc45157"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:16.784645 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-91132b33-ee18-4d56-821c-5b8630ea0d02 req-6184d20e-840a-416e-923f-eb5f89e344b3 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.785273 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-91132b33-ee18-4d56-821c-5b8630ea0d02 req-6184d20e-840a-416e-923f-eb5f89e344b3 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.798276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-91132b33-ee18-4d56-821c-5b8630ea0d02 req-6184d20e-840a-416e-923f-eb5f89e344b3 service nova] Creating event network-changed:c8f5dcd2-0154-47c8-a079-036b5cc45157 for instance 886b14f7-f670-4e46-b25f-1fd2502c5fce on hv-cinder-84617 Jul 18 16:55:16.803538 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-91132b33-ee18-4d56-821c-5b8630ea0d02 req-6184d20e-840a-416e-923f-eb5f89e344b3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034497 Jul 18 16:55:16.804336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 273/567] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:16.807590 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-65efcb94-b7b3-47d1-bcb8-0e1070ee550a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:16.815552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-65efcb94-b7b3-47d1-bcb8-0e1070ee550a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.171896 Jul 18 16:55:16.816331 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 295/568] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:16 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:17.716732 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c02dce01-35de-4097-86e1-ea54c4ccf480 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:17.717461 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c02dce01-35de-4097-86e1-ea54c4ccf480 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:17.723975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c02dce01-35de-4097-86e1-ea54c4ccf480 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:17.724423 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c02dce01-35de-4097-86e1-ea54c4ccf480 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:17.725358 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c02dce01-35de-4097-86e1-ea54c4ccf480 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:17.725785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c02dce01-35de-4097-86e1-ea54c4ccf480 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:17.833374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c137e577-9788-49ff-86ff-87964204eb5d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:17.834330 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c137e577-9788-49ff-86ff-87964204eb5d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:17.841255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c137e577-9788-49ff-86ff-87964204eb5d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:17.841770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c137e577-9788-49ff-86ff-87964204eb5d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:17.842746 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c137e577-9788-49ff-86ff-87964204eb5d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:17.843271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c137e577-9788-49ff-86ff-87964204eb5d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:17.877181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c02dce01-35de-4097-86e1-ea54c4ccf480 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:17.885792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c02dce01-35de-4097-86e1-ea54c4ccf480 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.174292 Jul 18 16:55:17.886391 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 274/569] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:17 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:17.980141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c137e577-9788-49ff-86ff-87964204eb5d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:17.987960 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c137e577-9788-49ff-86ff-87964204eb5d tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.158728 Jul 18 16:55:17.988524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 296/570] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:17 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:18.907829 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-397bc559-d339-428a-9ee3-c3bdba1e9cf0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:18.908435 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-397bc559-d339-428a-9ee3-c3bdba1e9cf0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:18.914998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-397bc559-d339-428a-9ee3-c3bdba1e9cf0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:18.915447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-397bc559-d339-428a-9ee3-c3bdba1e9cf0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:18.916208 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-397bc559-d339-428a-9ee3-c3bdba1e9cf0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:18.916641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-397bc559-d339-428a-9ee3-c3bdba1e9cf0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:19.003942 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-36caaff5-18fc-49b0-93f0-2fa174d7530e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:19.004555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-36caaff5-18fc-49b0-93f0-2fa174d7530e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:19.011388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-36caaff5-18fc-49b0-93f0-2fa174d7530e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:19.011847 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-36caaff5-18fc-49b0-93f0-2fa174d7530e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:19.012617 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-36caaff5-18fc-49b0-93f0-2fa174d7530e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:19.013087 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-36caaff5-18fc-49b0-93f0-2fa174d7530e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:19.065980 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-397bc559-d339-428a-9ee3-c3bdba1e9cf0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:19.074075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-397bc559-d339-428a-9ee3-c3bdba1e9cf0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.170155 Jul 18 16:55:19.074650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 275/571] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:18 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:19.147336 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-36caaff5-18fc-49b0-93f0-2fa174d7530e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:19.155018 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-36caaff5-18fc-49b0-93f0-2fa174d7530e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.155020 Jul 18 16:55:19.155585 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 297/572] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:18 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:20.091771 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f823e107-5989-42a4-93a0-5880a5b428bf tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:20.092383 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f823e107-5989-42a4-93a0-5880a5b428bf tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:20.098932 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f823e107-5989-42a4-93a0-5880a5b428bf tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:20.099413 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f823e107-5989-42a4-93a0-5880a5b428bf tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.100185 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f823e107-5989-42a4-93a0-5880a5b428bf tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:20.100620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f823e107-5989-42a4-93a0-5880a5b428bf tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.172534 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6afefb1c-d529-4f22-b8ee-0cc7d5530dbc tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:20.173095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6afefb1c-d529-4f22-b8ee-0cc7d5530dbc tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:20.179652 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6afefb1c-d529-4f22-b8ee-0cc7d5530dbc tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:20.180095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6afefb1c-d529-4f22-b8ee-0cc7d5530dbc tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.180862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6afefb1c-d529-4f22-b8ee-0cc7d5530dbc tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:20.181319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6afefb1c-d529-4f22-b8ee-0cc7d5530dbc tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.258842 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f823e107-5989-42a4-93a0-5880a5b428bf tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:20.267689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f823e107-5989-42a4-93a0-5880a5b428bf tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.180120 Jul 18 16:55:20.268606 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 276/573] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:20 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:20.321031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6afefb1c-d529-4f22-b8ee-0cc7d5530dbc tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:20.329666 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6afefb1c-d529-4f22-b8ee-0cc7d5530dbc tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.161796 Jul 18 16:55:20.330237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 298/574] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:20 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:20.431613 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ba4f7dd3-0a12-4400-a706-fdc357263a48 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:20.432106 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ba4f7dd3-0a12-4400-a706-fdc357263a48 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:20.438663 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ba4f7dd3-0a12-4400-a706-fdc357263a48 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:20.439110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ba4f7dd3-0a12-4400-a706-fdc357263a48 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.439863 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ba4f7dd3-0a12-4400-a706-fdc357263a48 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:20.440309 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ba4f7dd3-0a12-4400-a706-fdc357263a48 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.520334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-ba4f7dd3-0a12-4400-a706-fdc357263a48 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lazy-loading 'services' on Instance uuid c0010eb6-67ea-4a2a-8684-87247f78b6ce {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:55:20.691105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ba4f7dd3-0a12-4400-a706-fdc357263a48 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce/os-volume_attachments/4d820296-3f43-4106-93b9-b0f2a14019f2" status: 202 len: 0 microversion: 2.1 time: 0.263180 Jul 18 16:55:20.691608 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 277/575] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:55:20 2022] DELETE /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce/os-volume_attachments/4d820296-3f43-4106-93b9-b0f2a14019f2 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:55:21.284912 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a2eac3f3-bd64-4213-ab93-4e97c5290bb8 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:21.285526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a2eac3f3-bd64-4213-ab93-4e97c5290bb8 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:21.292152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2eac3f3-bd64-4213-ab93-4e97c5290bb8 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.292623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2eac3f3-bd64-4213-ab93-4e97c5290bb8 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.293942 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2eac3f3-bd64-4213-ab93-4e97c5290bb8 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.294368 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a2eac3f3-bd64-4213-ab93-4e97c5290bb8 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.348285 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8b9c69f3-9961-470a-9321-401bb3870ee4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:21.349044 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8b9c69f3-9961-470a-9321-401bb3870ee4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:21.355386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8b9c69f3-9961-470a-9321-401bb3870ee4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.355871 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8b9c69f3-9961-470a-9321-401bb3870ee4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.356758 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8b9c69f3-9961-470a-9321-401bb3870ee4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.357100 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8b9c69f3-9961-470a-9321-401bb3870ee4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.442619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a2eac3f3-bd64-4213-ab93-4e97c5290bb8 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:21.451465 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a2eac3f3-bd64-4213-ab93-4e97c5290bb8 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.170365 Jul 18 16:55:21.452136 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 299/576] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:21 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:21.493209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8b9c69f3-9961-470a-9321-401bb3870ee4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:21.500600 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8b9c69f3-9961-470a-9321-401bb3870ee4 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.156967 Jul 18 16:55:21.501212 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 278/577] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:21 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:22.165360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-0835b47f-a36f-465a-bb95-cf47054c76d0 req-2d62c47a-48c2-4411-af72-19eeb751881b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886b14f7-f670-4e46-b25f-1fd2502c5fce", "name": "network-vif-plugged", "status": "completed", "tag": "c8f5dcd2-0154-47c8-a079-036b5cc45157"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:22.174850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-0835b47f-a36f-465a-bb95-cf47054c76d0 req-2d62c47a-48c2-4411-af72-19eeb751881b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.175298 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-0835b47f-a36f-465a-bb95-cf47054c76d0 req-2d62c47a-48c2-4411-af72-19eeb751881b service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.191725 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-0835b47f-a36f-465a-bb95-cf47054c76d0 req-2d62c47a-48c2-4411-af72-19eeb751881b service nova] Creating event network-vif-plugged:c8f5dcd2-0154-47c8-a079-036b5cc45157 for instance 886b14f7-f670-4e46-b25f-1fd2502c5fce on hv-cinder-84617 Jul 18 16:55:22.193942 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-0835b47f-a36f-465a-bb95-cf47054c76d0 req-2d62c47a-48c2-4411-af72-19eeb751881b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Jul 18 16:55:22.194549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 300/578] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:22.469127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0b444d1c-324b-493e-ba3d-18eef5efe36d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:22.469836 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0b444d1c-324b-493e-ba3d-18eef5efe36d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:22.476452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0b444d1c-324b-493e-ba3d-18eef5efe36d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.476925 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0b444d1c-324b-493e-ba3d-18eef5efe36d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.477700 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0b444d1c-324b-493e-ba3d-18eef5efe36d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.478138 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0b444d1c-324b-493e-ba3d-18eef5efe36d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.519324 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b9f457b6-2951-4f70-a750-bf192c68173c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:22.520032 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b9f457b6-2951-4f70-a750-bf192c68173c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:22.527858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b9f457b6-2951-4f70-a750-bf192c68173c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.528317 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b9f457b6-2951-4f70-a750-bf192c68173c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.529146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b9f457b6-2951-4f70-a750-bf192c68173c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.529592 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b9f457b6-2951-4f70-a750-bf192c68173c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.676358 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b9f457b6-2951-4f70-a750-bf192c68173c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:22.684824 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b9f457b6-2951-4f70-a750-bf192c68173c tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.169420 Jul 18 16:55:22.685436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 301/579] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:22 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:22.692833 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0b444d1c-324b-493e-ba3d-18eef5efe36d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:22.701574 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0b444d1c-324b-493e-ba3d-18eef5efe36d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.236918 Jul 18 16:55:22.702142 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 279/580] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:22 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:22.863283 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-02ee85c5-196e-4c62-a510-989cad3ea87a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:22.863782 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-02ee85c5-196e-4c62-a510-989cad3ea87a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:22.869839 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-02ee85c5-196e-4c62-a510-989cad3ea87a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.870288 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-02ee85c5-196e-4c62-a510-989cad3ea87a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.871047 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-02ee85c5-196e-4c62-a510-989cad3ea87a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.871487 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-02ee85c5-196e-4c62-a510-989cad3ea87a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.895941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-02ee85c5-196e-4c62-a510-989cad3ea87a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:55:22.932217 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:23.226569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-02ee85c5-196e-4c62-a510-989cad3ea87a tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 204 len: 0 microversion: 2.1 time: 0.366843 Jul 18 16:55:23.227163 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 302/581] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:55:22 2022] DELETE /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:55:23.236040 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f928113c-05e5-4c4a-97e7-304e77e51e71 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:23.240482 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f928113c-05e5-4c4a-97e7-304e77e51e71 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:23.242889 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f928113c-05e5-4c4a-97e7-304e77e51e71 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:23.243333 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f928113c-05e5-4c4a-97e7-304e77e51e71 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.244097 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f928113c-05e5-4c4a-97e7-304e77e51e71 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:23.244540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f928113c-05e5-4c4a-97e7-304e77e51e71 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.377589 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f928113c-05e5-4c4a-97e7-304e77e51e71 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:23.384972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f928113c-05e5-4c4a-97e7-304e77e51e71 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1513 microversion: 2.1 time: 0.152794 Jul 18 16:55:23.385541 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 280/582] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:23 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:23.703153 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b23567ad-b92b-40d6-a83f-d5eccc852444 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:23.703809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b23567ad-b92b-40d6-a83f-d5eccc852444 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:23.710555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b23567ad-b92b-40d6-a83f-d5eccc852444 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:23.711015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b23567ad-b92b-40d6-a83f-d5eccc852444 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.711785 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b23567ad-b92b-40d6-a83f-d5eccc852444 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:23.712225 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b23567ad-b92b-40d6-a83f-d5eccc852444 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.719449 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d02df80c-2cce-4fc2-a968-9c557911a6d0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:23.720056 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d02df80c-2cce-4fc2-a968-9c557911a6d0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:23.726625 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d02df80c-2cce-4fc2-a968-9c557911a6d0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:23.727063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d02df80c-2cce-4fc2-a968-9c557911a6d0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.727818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d02df80c-2cce-4fc2-a968-9c557911a6d0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:23.728249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d02df80c-2cce-4fc2-a968-9c557911a6d0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.849666 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b23567ad-b92b-40d6-a83f-d5eccc852444 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:23.857947 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b23567ad-b92b-40d6-a83f-d5eccc852444 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.159359 Jul 18 16:55:23.858633 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 303/583] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:23 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:23.874917 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d02df80c-2cce-4fc2-a968-9c557911a6d0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:23.882816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d02df80c-2cce-4fc2-a968-9c557911a6d0 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.167565 Jul 18 16:55:23.883385 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 281/584] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:23 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:24.404124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6d28bf50-fc77-41b0-8fb5-71a4248adc5f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:24.404868 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6d28bf50-fc77-41b0-8fb5-71a4248adc5f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:24.411768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6d28bf50-fc77-41b0-8fb5-71a4248adc5f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:24.412213 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6d28bf50-fc77-41b0-8fb5-71a4248adc5f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:24.413015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6d28bf50-fc77-41b0-8fb5-71a4248adc5f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:24.413452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6d28bf50-fc77-41b0-8fb5-71a4248adc5f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:24.547252 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6d28bf50-fc77-41b0-8fb5-71a4248adc5f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:24.555019 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6d28bf50-fc77-41b0-8fb5-71a4248adc5f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1513 microversion: 2.1 time: 0.155676 Jul 18 16:55:24.555582 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 304/585] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:24 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:24.874215 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-35fb76a9-9c95-4caf-95e4-a847cdaf88f9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:24.874824 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-35fb76a9-9c95-4caf-95e4-a847cdaf88f9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:24.881441 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-35fb76a9-9c95-4caf-95e4-a847cdaf88f9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:24.881916 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-35fb76a9-9c95-4caf-95e4-a847cdaf88f9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:24.882678 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-35fb76a9-9c95-4caf-95e4-a847cdaf88f9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:24.883120 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-35fb76a9-9c95-4caf-95e4-a847cdaf88f9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:24.904137 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f0bf3438-b51b-4ce8-927b-6b41d37445cb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:24.904776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f0bf3438-b51b-4ce8-927b-6b41d37445cb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:24.911202 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0bf3438-b51b-4ce8-927b-6b41d37445cb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:24.911655 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0bf3438-b51b-4ce8-927b-6b41d37445cb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:24.912427 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0bf3438-b51b-4ce8-927b-6b41d37445cb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:24.912867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f0bf3438-b51b-4ce8-927b-6b41d37445cb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:25.015250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-35fb76a9-9c95-4caf-95e4-a847cdaf88f9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:25.022885 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-35fb76a9-9c95-4caf-95e4-a847cdaf88f9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1361 microversion: 2.1 time: 0.152596 Jul 18 16:55:25.023463 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 282/586] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:24 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:25.057710 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f0bf3438-b51b-4ce8-927b-6b41d37445cb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:25.065663 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f0bf3438-b51b-4ce8-927b-6b41d37445cb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.165935 Jul 18 16:55:25.066234 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 305/587] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:24 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:25.573172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2424b005-681f-40e4-8780-d34271cbf850 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:25.573780 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2424b005-681f-40e4-8780-d34271cbf850 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:25.581207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2424b005-681f-40e4-8780-d34271cbf850 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:25.581586 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2424b005-681f-40e4-8780-d34271cbf850 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:25.582469 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2424b005-681f-40e4-8780-d34271cbf850 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:25.582891 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2424b005-681f-40e4-8780-d34271cbf850 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:25.720588 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2424b005-681f-40e4-8780-d34271cbf850 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:25.724166 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:25.728527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2424b005-681f-40e4-8780-d34271cbf850 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1513 microversion: 2.1 time: 0.159716 Jul 18 16:55:25.729128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 283/588] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:25 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:26.041276 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a0586a9e-855a-4748-9a1e-bff337204e95 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:26.041885 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a0586a9e-855a-4748-9a1e-bff337204e95 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:26.048471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a0586a9e-855a-4748-9a1e-bff337204e95 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.048858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a0586a9e-855a-4748-9a1e-bff337204e95 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.049714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a0586a9e-855a-4748-9a1e-bff337204e95 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.050088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a0586a9e-855a-4748-9a1e-bff337204e95 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.083908 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ca3c92d6-d58c-4808-bddd-a5c2a1f7464d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:26.084670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ca3c92d6-d58c-4808-bddd-a5c2a1f7464d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:26.092540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ca3c92d6-d58c-4808-bddd-a5c2a1f7464d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.093189 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ca3c92d6-d58c-4808-bddd-a5c2a1f7464d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.093907 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ca3c92d6-d58c-4808-bddd-a5c2a1f7464d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.094358 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ca3c92d6-d58c-4808-bddd-a5c2a1f7464d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.185251 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a0586a9e-855a-4748-9a1e-bff337204e95 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:26.193008 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a0586a9e-855a-4748-9a1e-bff337204e95 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1546 microversion: 2.1 time: 0.156085 Jul 18 16:55:26.193591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 306/589] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:26 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:26.210091 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cd20294e-722f-42bf-a181-a3ff1aefc02b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:26.210716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cd20294e-722f-42bf-a181-a3ff1aefc02b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:26.216674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cd20294e-722f-42bf-a181-a3ff1aefc02b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.217178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cd20294e-722f-42bf-a181-a3ff1aefc02b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.217944 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cd20294e-722f-42bf-a181-a3ff1aefc02b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.218381 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cd20294e-722f-42bf-a181-a3ff1aefc02b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.240540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ca3c92d6-d58c-4808-bddd-a5c2a1f7464d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:26.249255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ca3c92d6-d58c-4808-bddd-a5c2a1f7464d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.169437 Jul 18 16:55:26.250030 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 284/590] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:26 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:26.296513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cd20294e-722f-42bf-a181-a3ff1aefc02b tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090172 Jul 18 16:55:26.297137 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 307/591] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 16:55:26 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:55:26.755041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4fb08e8d-1d84-41c4-8925-b2304e9f0271 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:26.755694 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4fb08e8d-1d84-41c4-8925-b2304e9f0271 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:26.762234 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4fb08e8d-1d84-41c4-8925-b2304e9f0271 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.762699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4fb08e8d-1d84-41c4-8925-b2304e9f0271 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.763472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4fb08e8d-1d84-41c4-8925-b2304e9f0271 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.763908 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4fb08e8d-1d84-41c4-8925-b2304e9f0271 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.975088 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4fb08e8d-1d84-41c4-8925-b2304e9f0271 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:26.983527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4fb08e8d-1d84-41c4-8925-b2304e9f0271 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1513 microversion: 2.1 time: 0.232585 Jul 18 16:55:26.984517 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 285/592] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:26 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:27.185314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-f547dc92-4aac-4b3b-9c28-27ce9be62917 req-b32d5cec-aa4e-4628-8942-415361e23bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0010eb6-67ea-4a2a-8684-87247f78b6ce", "name": "network-vif-deleted", "tag": "6c131419-d2f0-46b1-88f4-f0b44fbdd035"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:27.194219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-f547dc92-4aac-4b3b-9c28-27ce9be62917 req-b32d5cec-aa4e-4628-8942-415361e23bdc service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:27.194673 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-f547dc92-4aac-4b3b-9c28-27ce9be62917 req-b32d5cec-aa4e-4628-8942-415361e23bdc service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:27.207427 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-f547dc92-4aac-4b3b-9c28-27ce9be62917 req-b32d5cec-aa4e-4628-8942-415361e23bdc service nova] Creating event network-vif-deleted:6c131419-d2f0-46b1-88f4-f0b44fbdd035 for instance c0010eb6-67ea-4a2a-8684-87247f78b6ce on hv-cinder-84617 Jul 18 16:55:27.212677 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-f547dc92-4aac-4b3b-9c28-27ce9be62917 req-b32d5cec-aa4e-4628-8942-415361e23bdc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032395 Jul 18 16:55:27.213353 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 308/593] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:27.266694 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-dbe50016-bf4f-42b8-9973-68bdd7d337c1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:27.267590 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-dbe50016-bf4f-42b8-9973-68bdd7d337c1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:27.274153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbe50016-bf4f-42b8-9973-68bdd7d337c1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:27.274506 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbe50016-bf4f-42b8-9973-68bdd7d337c1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:27.275310 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbe50016-bf4f-42b8-9973-68bdd7d337c1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:27.275712 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-dbe50016-bf4f-42b8-9973-68bdd7d337c1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:27.430903 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-dbe50016-bf4f-42b8-9973-68bdd7d337c1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:27.441967 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-dbe50016-bf4f-42b8-9973-68bdd7d337c1 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.178973 Jul 18 16:55:27.442647 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 286/594] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:27 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:27.525484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-6fda023e-2a84-4b83-9260-a8dbf2a801a5 req-c5df769c-4625-4f95-826e-6d1df1eb25fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886b14f7-f670-4e46-b25f-1fd2502c5fce", "tag": "c8f5dcd2-0154-47c8-a079-036b5cc45157"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:27.535469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-6fda023e-2a84-4b83-9260-a8dbf2a801a5 req-c5df769c-4625-4f95-826e-6d1df1eb25fa service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:27.543558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-6fda023e-2a84-4b83-9260-a8dbf2a801a5 req-c5df769c-4625-4f95-826e-6d1df1eb25fa service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:27.547384 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-6fda023e-2a84-4b83-9260-a8dbf2a801a5 req-c5df769c-4625-4f95-826e-6d1df1eb25fa service nova] Creating event network-changed:c8f5dcd2-0154-47c8-a079-036b5cc45157 for instance 886b14f7-f670-4e46-b25f-1fd2502c5fce on hv-cinder-84617 Jul 18 16:55:27.552719 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-6fda023e-2a84-4b83-9260-a8dbf2a801a5 req-c5df769c-4625-4f95-826e-6d1df1eb25fa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032650 Jul 18 16:55:27.553552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 309/595] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:28.003231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:28.003875 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:28.010304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:28.013408 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:28.013408 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:28.013408 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:28.046755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:28.046755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:28.046755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lazy-loading 'fault' on Instance uuid c0010eb6-67ea-4a2a-8684-87247f78b6ce {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:55:28.118063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0641fc86a43f7a6c772add1e2ae48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe102d227ea4f60bdf22c20cd028341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:28.125945 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ddae3555-bd1a-47f0-9a9a-0e0ede213c0f tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 200 len: 1308 microversion: 2.1 time: 0.128210 Jul 18 16:55:28.126727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 287/596] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:27 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:28.461399 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-adcb0b9a-ca69-4d45-a166-b8d62a6f4369 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:28.462138 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-adcb0b9a-ca69-4d45-a166-b8d62a6f4369 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:28.469093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-adcb0b9a-ca69-4d45-a166-b8d62a6f4369 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:28.469574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-adcb0b9a-ca69-4d45-a166-b8d62a6f4369 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:28.470386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-adcb0b9a-ca69-4d45-a166-b8d62a6f4369 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:28.470820 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-adcb0b9a-ca69-4d45-a166-b8d62a6f4369 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:28.627001 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-adcb0b9a-ca69-4d45-a166-b8d62a6f4369 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:28.637766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-adcb0b9a-ca69-4d45-a166-b8d62a6f4369 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.179263 Jul 18 16:55:28.637766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 310/597] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:28 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:29.143236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:29.143804 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] [instance: c0010eb6-67ea-4a2a-8684-87247f78b6ce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:29.150304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.150749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.151515 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.151950 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.165815 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] HTTP exception thrown: Instance c0010eb6-67ea-4a2a-8684-87247f78b6ce could not be found. Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Request method failure captured: Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce HTTP/1.1 Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y_xER0ehBJqS8dovWPiQl61YkGa0cNaRUi9gBbiMjGUqSWrnwPfgeaWH2G2ApUE7u5Q6qcjRru7YhlEVsoSRyWqzv40zSqbal08MymkZEwfojTVAu2MA7xGBQ9Q355ni6X4IRI09GItYMKhwjtyx_BygfaYJAYe-zuSH031D1o13MI Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 4fe102d227ea4f60bdf22c20cd028341 Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1428294010 Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:55:29.167443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4fe102d227ea4f60bdf22c20cd028341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4fe102d227ea4f60bdf22c20cd028341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4fe102d227ea4f60bdf22c20cd028341", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4fe102d227ea4f60bdf22c20cd028341"}]}] Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-VolumesSnapshotTestJSON-1428294010 Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 4fe102d227ea4f60bdf22c20cd028341 Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1428294010 Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-VolumesSnapshotTestJSON-1428294010-project Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 81d0641fc86a43f7a6c772add1e2ae48 Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-VolumesSnapshotTestJSON-1428294010-project Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance c0010eb6-67ea-4a2a-8684-87247f78b6ce could not be found. Jul 18 16:55:29.169892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': 'c0010eb6-67ea-4a2a-8684-87247f78b6ce'} Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0010eb6-67ea-4a2a-8684-87247f78b6ce could not be found. Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:55:29.170818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0010eb6-67ea-4a2a-8684-87247f78b6ce could not be found. Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0010eb6-67ea-4a2a-8684-87247f78b6ce could not be found. Jul 18 16:55:29.172278 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:29.173649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] Returning 404 to user: Instance c0010eb6-67ea-4a2a-8684-87247f78b6ce could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:55:29.173649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5a30b991-a184-4b92-99c5-1d552baa3d37 tempest-VolumesSnapshotTestJSON-1428294010 tempest-VolumesSnapshotTestJSON-1428294010-project] 10.222.0.88 "GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce" status: 404 len: 111 microversion: 2.1 time: 0.030173 Jul 18 16:55:29.173649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 288/598] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:29 2022] GET /compute/v2.1/servers/c0010eb6-67ea-4a2a-8684-87247f78b6ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:55:29.653272 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-50d49db2-6a9d-43ad-bf4e-4bfb193a414b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:29.653870 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-50d49db2-6a9d-43ad-bf4e-4bfb193a414b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:29.661187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-50d49db2-6a9d-43ad-bf4e-4bfb193a414b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.661650 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-50d49db2-6a9d-43ad-bf4e-4bfb193a414b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.662434 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-50d49db2-6a9d-43ad-bf4e-4bfb193a414b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.662970 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-50d49db2-6a9d-43ad-bf4e-4bfb193a414b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.812696 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-50d49db2-6a9d-43ad-bf4e-4bfb193a414b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:29.821385 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-50d49db2-6a9d-43ad-bf4e-4bfb193a414b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.172480 Jul 18 16:55:29.821961 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 311/599] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:29 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:30.838723 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-42c3996e-9daf-4bdb-b2ef-a0c9b84a075c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:30.839257 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-42c3996e-9daf-4bdb-b2ef-a0c9b84a075c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:30.845555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42c3996e-9daf-4bdb-b2ef-a0c9b84a075c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:30.845996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42c3996e-9daf-4bdb-b2ef-a0c9b84a075c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:30.846750 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42c3996e-9daf-4bdb-b2ef-a0c9b84a075c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:30.847181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42c3996e-9daf-4bdb-b2ef-a0c9b84a075c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:30.994440 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-42c3996e-9daf-4bdb-b2ef-a0c9b84a075c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:31.003032 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-42c3996e-9daf-4bdb-b2ef-a0c9b84a075c tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.168464 Jul 18 16:55:31.003610 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 289/600] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:30 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:32.021267 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5cbe81b5-27df-4d9b-8869-5f7f5fdaf95b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:32.021850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5cbe81b5-27df-4d9b-8869-5f7f5fdaf95b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:32.029115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5cbe81b5-27df-4d9b-8869-5f7f5fdaf95b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.029529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5cbe81b5-27df-4d9b-8869-5f7f5fdaf95b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.030291 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5cbe81b5-27df-4d9b-8869-5f7f5fdaf95b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.030747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5cbe81b5-27df-4d9b-8869-5f7f5fdaf95b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.180468 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5cbe81b5-27df-4d9b-8869-5f7f5fdaf95b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:32.189239 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5cbe81b5-27df-4d9b-8869-5f7f5fdaf95b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.172112 Jul 18 16:55:32.189749 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 312/601] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:32 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:33.207041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3676bc8d-462b-4fd4-99ef-b2691545a9d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:33.207588 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3676bc8d-462b-4fd4-99ef-b2691545a9d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:33.214026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3676bc8d-462b-4fd4-99ef-b2691545a9d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:33.214464 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3676bc8d-462b-4fd4-99ef-b2691545a9d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:33.215325 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3676bc8d-462b-4fd4-99ef-b2691545a9d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:33.215753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3676bc8d-462b-4fd4-99ef-b2691545a9d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:33.356060 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3676bc8d-462b-4fd4-99ef-b2691545a9d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:33.364106 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3676bc8d-462b-4fd4-99ef-b2691545a9d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.161409 Jul 18 16:55:33.364682 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 290/602] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:33 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:34.381934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-18bef459-296d-4b48-9c35-d78da8a5e222 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:34.382529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-18bef459-296d-4b48-9c35-d78da8a5e222 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:34.385064 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:34.390438 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18bef459-296d-4b48-9c35-d78da8a5e222 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.390896 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18bef459-296d-4b48-9c35-d78da8a5e222 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.391667 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18bef459-296d-4b48-9c35-d78da8a5e222 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.392111 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18bef459-296d-4b48-9c35-d78da8a5e222 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.535554 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-18bef459-296d-4b48-9c35-d78da8a5e222 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:34.544107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-18bef459-296d-4b48-9c35-d78da8a5e222 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.166088 Jul 18 16:55:34.544770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 313/603] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:34 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:35.562085 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-12112335-aff8-4f07-baf4-44942668a00d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:35.562688 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-12112335-aff8-4f07-baf4-44942668a00d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:35.569267 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-12112335-aff8-4f07-baf4-44942668a00d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.569716 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-12112335-aff8-4f07-baf4-44942668a00d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.570476 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-12112335-aff8-4f07-baf4-44942668a00d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.570941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-12112335-aff8-4f07-baf4-44942668a00d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.716075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-12112335-aff8-4f07-baf4-44942668a00d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:35.724003 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-12112335-aff8-4f07-baf4-44942668a00d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.166410 Jul 18 16:55:35.724576 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 291/604] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:35 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:36.741541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bda1d99c-3425-499a-bb0e-31360e3a882d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:36.742084 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bda1d99c-3425-499a-bb0e-31360e3a882d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:36.748852 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bda1d99c-3425-499a-bb0e-31360e3a882d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.749340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bda1d99c-3425-499a-bb0e-31360e3a882d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.750113 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bda1d99c-3425-499a-bb0e-31360e3a882d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.750555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bda1d99c-3425-499a-bb0e-31360e3a882d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.896713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-bda1d99c-3425-499a-bb0e-31360e3a882d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:36.904965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bda1d99c-3425-499a-bb0e-31360e3a882d tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1755 microversion: 2.1 time: 0.167751 Jul 18 16:55:36.905538 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 314/605] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:36 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:37.922468 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8d51d508-e210-46da-a3e1-adea973f5ea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:37.922999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8d51d508-e210-46da-a3e1-adea973f5ea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:37.925441 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:37.930561 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8d51d508-e210-46da-a3e1-adea973f5ea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.931006 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8d51d508-e210-46da-a3e1-adea973f5ea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.931775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8d51d508-e210-46da-a3e1-adea973f5ea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:37.932398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8d51d508-e210-46da-a3e1-adea973f5ea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.104555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8d51d508-e210-46da-a3e1-adea973f5ea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:38.113207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8d51d508-e210-46da-a3e1-adea973f5ea3 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1758 microversion: 2.1 time: 0.194649 Jul 18 16:55:38.120939 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 292/606] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:37 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:41.546507 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3db1797a-2a10-44e8-8ffa-e46e392feb86 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:41.547035 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3db1797a-2a10-44e8-8ffa-e46e392feb86 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:41.554350 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3db1797a-2a10-44e8-8ffa-e46e392feb86 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.554804 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3db1797a-2a10-44e8-8ffa-e46e392feb86 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.555692 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3db1797a-2a10-44e8-8ffa-e46e392feb86 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.556007 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3db1797a-2a10-44e8-8ffa-e46e392feb86 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.635401 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-3db1797a-2a10-44e8-8ffa-e46e392feb86 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'services' on Instance uuid 5b3504a1-341a-4a72-9cd1-0597e63ffa7d {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:55:41.849084 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3db1797a-2a10-44e8-8ffa-e46e392feb86 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments/c1672945-d502-4d41-b9ce-85a02e9880bc" status: 202 len: 0 microversion: 2.1 time: 0.306757 Jul 18 16:55:41.849833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 315/607] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:55:41 2022] DELETE /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments/c1672945-d502-4d41-b9ce-85a02e9880bc => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:55:41.858630 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5fe04f5a-fac5-4d9f-8bcf-50842ccfb151 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:41.859645 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5fe04f5a-fac5-4d9f-8bcf-50842ccfb151 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:41.866336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5fe04f5a-fac5-4d9f-8bcf-50842ccfb151 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.868477 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5fe04f5a-fac5-4d9f-8bcf-50842ccfb151 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.868477 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5fe04f5a-fac5-4d9f-8bcf-50842ccfb151 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.868477 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5fe04f5a-fac5-4d9f-8bcf-50842ccfb151 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.897482 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5fe04f5a-fac5-4d9f-8bcf-50842ccfb151 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043311 Jul 18 16:55:41.898049 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 293/608] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:55:41 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:42.910554 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-122532a5-c711-4718-84ca-46ca13f93463 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:42.911643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-122532a5-c711-4718-84ca-46ca13f93463 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:42.918636 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-122532a5-c711-4718-84ca-46ca13f93463 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:42.919087 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-122532a5-c711-4718-84ca-46ca13f93463 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:42.919862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-122532a5-c711-4718-84ca-46ca13f93463 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:42.920298 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-122532a5-c711-4718-84ca-46ca13f93463 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:42.953407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-122532a5-c711-4718-84ca-46ca13f93463 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 Jul 18 16:55:42.953407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 316/609] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:55:42 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:43.965078 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4b407feb-9db9-4a7b-b3e2-e82a3df2e608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:43.966026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4b407feb-9db9-4a7b-b3e2-e82a3df2e608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:43.972652 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b407feb-9db9-4a7b-b3e2-e82a3df2e608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:43.973137 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b407feb-9db9-4a7b-b3e2-e82a3df2e608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:43.973905 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b407feb-9db9-4a7b-b3e2-e82a3df2e608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:43.974339 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b407feb-9db9-4a7b-b3e2-e82a3df2e608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:44.003811 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4b407feb-9db9-4a7b-b3e2-e82a3df2e608 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 Jul 18 16:55:44.015113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 294/610] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:55:43 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:45.016016 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5f66a66f-8f8d-45cb-b889-33af3efa8f47 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:45.016973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5f66a66f-8f8d-45cb-b889-33af3efa8f47 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:45.023139 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5f66a66f-8f8d-45cb-b889-33af3efa8f47 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.023599 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5f66a66f-8f8d-45cb-b889-33af3efa8f47 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.024371 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5f66a66f-8f8d-45cb-b889-33af3efa8f47 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.024814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5f66a66f-8f8d-45cb-b889-33af3efa8f47 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.053691 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5f66a66f-8f8d-45cb-b889-33af3efa8f47 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042202 Jul 18 16:55:45.054485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 317/611] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:55:45 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:55:45.126151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ea74b3e2-8c58-4332-a453-4531ea9e2e40 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:45.126697 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ea74b3e2-8c58-4332-a453-4531ea9e2e40 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:45.133197 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea74b3e2-8c58-4332-a453-4531ea9e2e40 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.133641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea74b3e2-8c58-4332-a453-4531ea9e2e40 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.134394 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea74b3e2-8c58-4332-a453-4531ea9e2e40 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.134828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea74b3e2-8c58-4332-a453-4531ea9e2e40 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.161336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ea74b3e2-8c58-4332-a453-4531ea9e2e40 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:55:45.433061 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ea74b3e2-8c58-4332-a453-4531ea9e2e40 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 204 len: 0 microversion: 2.1 time: 0.310562 Jul 18 16:55:45.433652 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 295/612] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:55:45 2022] DELETE /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:55:45.442540 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d3d8a495-5a77-487c-a7dd-e78b995aae43 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:45.443713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d3d8a495-5a77-487c-a7dd-e78b995aae43 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:45.450599 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d3d8a495-5a77-487c-a7dd-e78b995aae43 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.450599 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d3d8a495-5a77-487c-a7dd-e78b995aae43 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.451364 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d3d8a495-5a77-487c-a7dd-e78b995aae43 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.451808 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d3d8a495-5a77-487c-a7dd-e78b995aae43 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.586161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d3d8a495-5a77-487c-a7dd-e78b995aae43 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:45.594456 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d3d8a495-5a77-487c-a7dd-e78b995aae43 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1689 microversion: 2.1 time: 0.155740 Jul 18 16:55:45.595035 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 318/613] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:45 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:46.612296 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a0780813-832e-4897-82b1-dba43176f8e3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:46.613002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a0780813-832e-4897-82b1-dba43176f8e3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:46.619637 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a0780813-832e-4897-82b1-dba43176f8e3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.620081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a0780813-832e-4897-82b1-dba43176f8e3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.620850 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a0780813-832e-4897-82b1-dba43176f8e3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.621367 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a0780813-832e-4897-82b1-dba43176f8e3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.752606 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a0780813-832e-4897-82b1-dba43176f8e3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:46.760221 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a0780813-832e-4897-82b1-dba43176f8e3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1689 microversion: 2.1 time: 0.153605 Jul 18 16:55:46.763753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 296/614] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:46 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:47.777164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6a7f5d97-f979-46bb-9fb4-4d3aeaebed63 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:47.777799 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6a7f5d97-f979-46bb-9fb4-4d3aeaebed63 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:47.784213 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6a7f5d97-f979-46bb-9fb4-4d3aeaebed63 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.784667 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6a7f5d97-f979-46bb-9fb4-4d3aeaebed63 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.785528 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6a7f5d97-f979-46bb-9fb4-4d3aeaebed63 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.785965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6a7f5d97-f979-46bb-9fb4-4d3aeaebed63 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.915143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6a7f5d97-f979-46bb-9fb4-4d3aeaebed63 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:47.918673 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:47.923453 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6a7f5d97-f979-46bb-9fb4-4d3aeaebed63 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1689 microversion: 2.1 time: 0.150282 Jul 18 16:55:47.925888 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 319/615] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:47 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:48.940264 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-42d3bc35-7e8f-443b-9efa-28cfadcd3546 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:48.940873 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-42d3bc35-7e8f-443b-9efa-28cfadcd3546 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:48.947528 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42d3bc35-7e8f-443b-9efa-28cfadcd3546 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:48.947976 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42d3bc35-7e8f-443b-9efa-28cfadcd3546 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:48.948739 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42d3bc35-7e8f-443b-9efa-28cfadcd3546 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:48.949200 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42d3bc35-7e8f-443b-9efa-28cfadcd3546 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:49.083342 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-42d3bc35-7e8f-443b-9efa-28cfadcd3546 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:49.090860 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-42d3bc35-7e8f-443b-9efa-28cfadcd3546 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1689 microversion: 2.1 time: 0.155020 Jul 18 16:55:49.091432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 297/616] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:48 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:50.113622 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-833f7ea1-64db-4c6b-8cc2-5cd89b4a1adc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:50.114251 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-833f7ea1-64db-4c6b-8cc2-5cd89b4a1adc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:50.121561 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-833f7ea1-64db-4c6b-8cc2-5cd89b4a1adc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:50.122013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-833f7ea1-64db-4c6b-8cc2-5cd89b4a1adc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:50.122840 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-833f7ea1-64db-4c6b-8cc2-5cd89b4a1adc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:50.123286 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-833f7ea1-64db-4c6b-8cc2-5cd89b4a1adc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:50.192380 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-833f7ea1-64db-4c6b-8cc2-5cd89b4a1adc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:50.200218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-833f7ea1-64db-4c6b-8cc2-5cd89b4a1adc tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1622 microversion: 2.1 time: 0.091187 Jul 18 16:55:50.200814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 320/617] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:50 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1622 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:50.725751 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-f2aef126-3b1c-4ef1-92cf-e088456e48d6 req-64b39b2e-eb6b-47e5-af5a-580da55158cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3504a1-341a-4a72-9cd1-0597e63ffa7d", "name": "network-vif-deleted", "tag": "b2759155-87eb-4bd6-b4ea-81f112800de2"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:50.733770 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-f2aef126-3b1c-4ef1-92cf-e088456e48d6 req-64b39b2e-eb6b-47e5-af5a-580da55158cb service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:50.737835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-f2aef126-3b1c-4ef1-92cf-e088456e48d6 req-64b39b2e-eb6b-47e5-af5a-580da55158cb service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:50.745779 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-f2aef126-3b1c-4ef1-92cf-e088456e48d6 req-64b39b2e-eb6b-47e5-af5a-580da55158cb service nova] Creating event network-vif-deleted:b2759155-87eb-4bd6-b4ea-81f112800de2 for instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d on hv-cinder-84617 Jul 18 16:55:50.751514 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-f2aef126-3b1c-4ef1-92cf-e088456e48d6 req-64b39b2e-eb6b-47e5-af5a-580da55158cb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088675 Jul 18 16:55:50.752133 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 298/618] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:51.222900 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:51.225524 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:51.230342 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.230794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.231558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.231990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.265419 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.265779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.266222 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'fault' on Instance uuid 5b3504a1-341a-4a72-9cd1-0597e63ffa7d {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:55:51.308107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:51.315699 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-073e2ca8-c91f-4d72-bca1-5924880859c7 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 200 len: 1334 microversion: 2.1 time: 0.097335 Jul 18 16:55:51.316282 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 321/619] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:51 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:52.334752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:52.335482 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 5b3504a1-341a-4a72-9cd1-0597e63ffa7d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:52.342018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.342504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.343475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.343737 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.357410 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] HTTP exception thrown: Instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d could not be found. Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Request method failure captured: Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d HTTP/1.1 Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y9CIuTubgqM74W1_pbe5k_tS6w9g7u9d3gDr9ZZ8_vU18vhSPDw4nQcs-sVbcs5CF14wI4yvButN1_qeoJe8XiWbIdGlymLgi-J1tlXq7Xbpn2ppklDf0u5U6c4ygl78ZQGY7WJNvxgE-ikmjSI_UwxizhN8rPrNBLY8DvlKOhUiOE Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:55:52.359553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6299ea3e56e84d3cbd2e8f74ef62510e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}] Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: f2d1f86034b94e289bb1fc754f02f4ac Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d could not be found. Jul 18 16:55:52.361132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '5b3504a1-341a-4a72-9cd1-0597e63ffa7d'} Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d could not be found. Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:55:52.362496 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d could not be found. Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d could not be found. Jul 18 16:55:52.364316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:55:52.366549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Returning 404 to user: Instance 5b3504a1-341a-4a72-9cd1-0597e63ffa7d could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:55:52.366549 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4941ab9e-c4ff-4d94-9080-138a12b0dbde tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d" status: 404 len: 111 microversion: 2.1 time: 0.030977 Jul 18 16:55:52.366958 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 299/620] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:52 2022] GET /compute/v2.1/servers/5b3504a1-341a-4a72-9cd1-0597e63ffa7d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:55:52.369707 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ecc9364d-8fa6-4de5-a216-4587cd26490a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '.version_select at 0x7fd4f51861f0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:52.450776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ecc9364d-8fa6-4de5-a216-4587cd26490a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45966551" status: 202 len: 0 microversion: 2.1 time: 0.084885 Jul 18 16:55:52.452440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 322/621] 10.222.0.88 () {58 vars in 1214 bytes} [Mon Jul 18 16:55:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45966551 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:55:55.780269 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c1ebb160-cf63-4b52-a8fd-9f9aa647fe7c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:55.780782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c1ebb160-cf63-4b52-a8fd-9f9aa647fe7c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:55.788967 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c1ebb160-cf63-4b52-a8fd-9f9aa647fe7c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.789418 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c1ebb160-cf63-4b52-a8fd-9f9aa647fe7c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.790196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c1ebb160-cf63-4b52-a8fd-9f9aa647fe7c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.790639 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c1ebb160-cf63-4b52-a8fd-9f9aa647fe7c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.812911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:55.820840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c1ebb160-cf63-4b52-a8fd-9f9aa647fe7c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:55:56.123176 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c1ebb160-cf63-4b52-a8fd-9f9aa647fe7c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "DELETE /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 204 len: 0 microversion: 2.1 time: 0.346364 Jul 18 16:55:56.123731 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 300/622] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:55:55 2022] DELETE /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:55:56.134125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a11b25e4-bc9b-49a9-a38d-98f1630b980b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:56.134741 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a11b25e4-bc9b-49a9-a38d-98f1630b980b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:56.140932 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a11b25e4-bc9b-49a9-a38d-98f1630b980b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:56.141370 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a11b25e4-bc9b-49a9-a38d-98f1630b980b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:56.142193 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a11b25e4-bc9b-49a9-a38d-98f1630b980b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:56.142758 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a11b25e4-bc9b-49a9-a38d-98f1630b980b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:56.281800 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a11b25e4-bc9b-49a9-a38d-98f1630b980b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:56.289959 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a11b25e4-bc9b-49a9-a38d-98f1630b980b tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1508 microversion: 2.1 time: 0.161092 Jul 18 16:55:56.290539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 323/623] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:56 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:57.307422 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c03f93ac-beff-42f1-969d-93dca2e98361 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:57.309323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c03f93ac-beff-42f1-969d-93dca2e98361 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:57.314979 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c03f93ac-beff-42f1-969d-93dca2e98361 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.315421 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c03f93ac-beff-42f1-969d-93dca2e98361 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.316176 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c03f93ac-beff-42f1-969d-93dca2e98361 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.316605 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c03f93ac-beff-42f1-969d-93dca2e98361 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.456442 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c03f93ac-beff-42f1-969d-93dca2e98361 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:57.463959 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c03f93ac-beff-42f1-969d-93dca2e98361 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1508 microversion: 2.1 time: 0.160801 Jul 18 16:55:57.464710 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 301/624] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:57 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:58.484142 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c1ad6b5f-75a0-4948-90e4-a878a94c559d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:58.486088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c1ad6b5f-75a0-4948-90e4-a878a94c559d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:58.497436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1ad6b5f-75a0-4948-90e4-a878a94c559d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.497958 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1ad6b5f-75a0-4948-90e4-a878a94c559d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.498823 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1ad6b5f-75a0-4948-90e4-a878a94c559d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.499258 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1ad6b5f-75a0-4948-90e4-a878a94c559d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.636116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c1ad6b5f-75a0-4948-90e4-a878a94c559d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:58.644528 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c1ad6b5f-75a0-4948-90e4-a878a94c559d tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1508 microversion: 2.1 time: 0.165297 Jul 18 16:55:58.645155 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 324/625] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:58 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:59.200674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-54c8d98e-ae75-405f-9dfe-e6b981730dff req-c8d253fc-4d91-4363-8545-af43cd500271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961bdca6-9130-4433-86dc-657618b53284", "name": "network-vif-deleted", "tag": "62fdbe46-c000-4272-99a3-12a2a443665b"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:55:59.209901 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-54c8d98e-ae75-405f-9dfe-e6b981730dff req-c8d253fc-4d91-4363-8545-af43cd500271 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.210616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-54c8d98e-ae75-405f-9dfe-e6b981730dff req-c8d253fc-4d91-4363-8545-af43cd500271 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.221803 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-54c8d98e-ae75-405f-9dfe-e6b981730dff req-c8d253fc-4d91-4363-8545-af43cd500271 service nova] Creating event network-vif-deleted:62fdbe46-c000-4272-99a3-12a2a443665b for instance 961bdca6-9130-4433-86dc-657618b53284 on hv-cinder-84617 Jul 18 16:55:59.226653 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-54c8d98e-ae75-405f-9dfe-e6b981730dff req-c8d253fc-4d91-4363-8545-af43cd500271 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029579 Jul 18 16:55:59.227255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 302/626] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:55:59.661512 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f1b44444-ea87-4aca-bb54-241c018ba032 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:59.662192 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f1b44444-ea87-4aca-bb54-241c018ba032 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:59.668488 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f1b44444-ea87-4aca-bb54-241c018ba032 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.668991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f1b44444-ea87-4aca-bb54-241c018ba032 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.669757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f1b44444-ea87-4aca-bb54-241c018ba032 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.670187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f1b44444-ea87-4aca-bb54-241c018ba032 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.737006 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f1b44444-ea87-4aca-bb54-241c018ba032 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:59.744816 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f1b44444-ea87-4aca-bb54-241c018ba032 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1293 microversion: 2.1 time: 0.087806 Jul 18 16:55:59.745469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 325/627] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:59 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:00.763222 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:00.763907 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:00.770219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.770661 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:00.771419 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.771852 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:00.802566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.803011 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:00.803452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'fault' on Instance uuid 961bdca6-9130-4433-86dc-657618b53284 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:00.845312 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:00.852707 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-daea919a-be05-4613-af6e-84cd44dcfb49 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1312 microversion: 2.1 time: 0.094231 Jul 18 16:56:00.853309 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 303/628] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:00 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:01.870033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:01.870621 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:01.877705 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.878152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.878911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.879344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.909261 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.909702 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.910144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'fault' on Instance uuid 961bdca6-9130-4433-86dc-657618b53284 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:01.953885 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:01.961832 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-68929798-83a2-4acc-b5fd-f94de3498020 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1312 microversion: 2.1 time: 0.095692 Jul 18 16:56:01.962397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 326/629] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:01 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:02.978827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:02.979432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:02.985956 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.986403 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.987705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.988139 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.019065 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:03.019507 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.019958 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'fault' on Instance uuid 961bdca6-9130-4433-86dc-657618b53284 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:03.061751 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:03.069890 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4b09586f-b210-4e72-ab15-ddb5ce26fd8c tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 200 len: 1312 microversion: 2.1 time: 0.094927 Jul 18 16:56:03.070475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 304/630] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:02 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:04.086176 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:04.086813 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 961bdca6-9130-4433-86dc-657618b53284] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:04.093331 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.093785 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.094551 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.094994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.109327 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] HTTP exception thrown: Instance 961bdca6-9130-4433-86dc-657618b53284 could not be found. Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Request method failure captured: Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 HTTP/1.1 Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y9CIuTubgqM74W1_pbe5k_tS6w9g7u9d3gDr9ZZ8_vU18vhSPDw4nQcs-sVbcs5CF14wI4yvButN1_qeoJe8XiWbIdGlymLgi-J1tlXq7Xbpn2ppklDf0u5U6c4ygl78ZQGY7WJNvxgE-ikmjSI_UwxizhN8rPrNBLY8DvlKOhUiOE Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:56:04.110980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6299ea3e56e84d3cbd2e8f74ef62510e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}] Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: f2d1f86034b94e289bb1fc754f02f4ac Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 961bdca6-9130-4433-86dc-657618b53284 could not be found. Jul 18 16:56:04.113517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '961bdca6-9130-4433-86dc-657618b53284'} Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961bdca6-9130-4433-86dc-657618b53284 could not be found. Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:04.115797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961bdca6-9130-4433-86dc-657618b53284 could not be found. Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961bdca6-9130-4433-86dc-657618b53284 could not be found. Jul 18 16:56:04.117125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:04.118242 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Returning 404 to user: Instance 961bdca6-9130-4433-86dc-657618b53284 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:04.118242 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6ad9f27f-e812-407b-b7da-3c708cbb1d0a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284" status: 404 len: 111 microversion: 2.1 time: 0.030691 Jul 18 16:56:04.118242 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 327/631] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:04 2022] GET /compute/v2.1/servers/961bdca6-9130-4433-86dc-657618b53284 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:04.125800 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1b110a1c-4821-4b05-9904-1306a7a8c30a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:04.126681 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1b110a1c-4821-4b05-9904-1306a7a8c30a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:04.137331 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1b110a1c-4821-4b05-9904-1306a7a8c30a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.138055 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1b110a1c-4821-4b05-9904-1306a7a8c30a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.139303 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1b110a1c-4821-4b05-9904-1306a7a8c30a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.140021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1b110a1c-4821-4b05-9904-1306a7a8c30a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.175937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1b110a1c-4821-4b05-9904-1306a7a8c30a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:56:04.477745 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1b110a1c-4821-4b05-9904-1306a7a8c30a tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 204 len: 0 microversion: 2.1 time: 0.357642 Jul 18 16:56:04.482353 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 305/632] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:56:04 2022] DELETE /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:56:04.486401 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-571f20d2-c3f7-4cdb-b819-0020d4e8aa51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:04.487014 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-571f20d2-c3f7-4cdb-b819-0020d4e8aa51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:04.493039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-571f20d2-c3f7-4cdb-b819-0020d4e8aa51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.493490 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-571f20d2-c3f7-4cdb-b819-0020d4e8aa51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.494250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-571f20d2-c3f7-4cdb-b819-0020d4e8aa51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.494684 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-571f20d2-c3f7-4cdb-b819-0020d4e8aa51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.639079 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-571f20d2-c3f7-4cdb-b819-0020d4e8aa51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:04.647228 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-571f20d2-c3f7-4cdb-b819-0020d4e8aa51 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.164722 Jul 18 16:56:04.652205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 328/633] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:04 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:05.671720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-616c6c8a-afec-47e5-a832-e8ff464feeb3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:05.671720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-616c6c8a-afec-47e5-a832-e8ff464feeb3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:05.671720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-616c6c8a-afec-47e5-a832-e8ff464feeb3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:05.671720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-616c6c8a-afec-47e5-a832-e8ff464feeb3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.672454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-616c6c8a-afec-47e5-a832-e8ff464feeb3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:05.672762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-616c6c8a-afec-47e5-a832-e8ff464feeb3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.811870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-616c6c8a-afec-47e5-a832-e8ff464feeb3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:05.819449 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-616c6c8a-afec-47e5-a832-e8ff464feeb3 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.159673 Jul 18 16:56:05.822962 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 306/634] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:05 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:06.836253 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-04369f80-28a7-4efe-9dc8-b1c922a98881 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:06.836901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-04369f80-28a7-4efe-9dc8-b1c922a98881 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:06.839237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:06.843865 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-04369f80-28a7-4efe-9dc8-b1c922a98881 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:06.844312 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-04369f80-28a7-4efe-9dc8-b1c922a98881 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:06.845098 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-04369f80-28a7-4efe-9dc8-b1c922a98881 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:06.845533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-04369f80-28a7-4efe-9dc8-b1c922a98881 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:06.980862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-04369f80-28a7-4efe-9dc8-b1c922a98881 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:06.989895 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-04369f80-28a7-4efe-9dc8-b1c922a98881 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.157439 Jul 18 16:56:06.990471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 329/635] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:06 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:08.007040 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-84789a92-344a-407a-ad00-0b81d5dc67c6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:08.008504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-84789a92-344a-407a-ad00-0b81d5dc67c6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:08.018784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-84789a92-344a-407a-ad00-0b81d5dc67c6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.019784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-84789a92-344a-407a-ad00-0b81d5dc67c6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.021575 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-84789a92-344a-407a-ad00-0b81d5dc67c6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.022394 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-84789a92-344a-407a-ad00-0b81d5dc67c6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.264875 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-5d4c98d6-f148-4a24-b9b6-d757a29f0f0e req-3b813c9e-f713-485e-885c-e602fec0358f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0acf48-1262-4cbc-98dc-562510f2cc10", "name": "network-vif-deleted", "tag": "e24ea19f-20d4-44b1-8b36-327ccde66e88"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:08.270323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-84789a92-344a-407a-ad00-0b81d5dc67c6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:08.275596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-5d4c98d6-f148-4a24-b9b6-d757a29f0f0e req-3b813c9e-f713-485e-885c-e602fec0358f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.276031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-5d4c98d6-f148-4a24-b9b6-d757a29f0f0e req-3b813c9e-f713-485e-885c-e602fec0358f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.278700 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-84789a92-344a-407a-ad00-0b81d5dc67c6 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1522 microversion: 2.1 time: 0.275674 Jul 18 16:56:08.279596 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 307/636] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:08 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:08.288668 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-5d4c98d6-f148-4a24-b9b6-d757a29f0f0e req-3b813c9e-f713-485e-885c-e602fec0358f service nova] Creating event network-vif-deleted:e24ea19f-20d4-44b1-8b36-327ccde66e88 for instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 on hv-cinder-84617 Jul 18 16:56:08.294290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-5d4c98d6-f148-4a24-b9b6-d757a29f0f0e req-3b813c9e-f713-485e-885c-e602fec0358f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034377 Jul 18 16:56:08.294968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 330/637] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:09.295790 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:09.296427 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:09.303094 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.303544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.304313 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.304746 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.337434 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:09.337877 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.338332 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lazy-loading 'fault' on Instance uuid 9b0acf48-1262-4cbc-98dc-562510f2cc10 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:09.380952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d1f86034b94e289bb1fc754f02f4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6299ea3e56e84d3cbd2e8f74ef62510e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:09.388129 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b55dfbb8-b13a-4bca-b361-4c7d41df2922 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 200 len: 1311 microversion: 2.1 time: 0.096151 Jul 18 16:56:09.388934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 308/638] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:09 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:10.408278 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:10.409708 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] [instance: 9b0acf48-1262-4cbc-98dc-562510f2cc10] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:10.415986 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.416430 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.417229 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.417829 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.431955 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] HTTP exception thrown: Instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 could not be found. Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Request method failure captured: Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 HTTP/1.1 Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y9CIuTubgqM74W1_pbe5k_tS6w9g7u9d3gDr9ZZ8_vU18vhSPDw4nQcs-sVbcs5CF14wI4yvButN1_qeoJe8XiWbIdGlymLgi-J1tlXq7Xbpn2ppklDf0u5U6c4ygl78ZQGY7WJNvxgE-ikmjSI_UwxizhN8rPrNBLY8DvlKOhUiOE Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:56:10.434581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6299ea3e56e84d3cbd2e8f74ef62510e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6299ea3e56e84d3cbd2e8f74ef62510e"}]}] Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 6299ea3e56e84d3cbd2e8f74ef62510e Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-883782384 Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: f2d1f86034b94e289bb1fc754f02f4ac Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-ServerRescueNegativeTestJSON-883782384-project Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 could not be found. Jul 18 16:56:10.436063 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '9b0acf48-1262-4cbc-98dc-562510f2cc10'} Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 could not be found. Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:10.436818 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 could not be found. Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 could not be found. Jul 18 16:56:10.438134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:10.439232 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] Returning 404 to user: Instance 9b0acf48-1262-4cbc-98dc-562510f2cc10 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:10.439232 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d5e028e4-e1ab-4673-b1f6-85dab41b1917 tempest-ServerRescueNegativeTestJSON-883782384 tempest-ServerRescueNegativeTestJSON-883782384-project] 10.222.0.88 "GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10" status: 404 len: 111 microversion: 2.1 time: 0.031445 Jul 18 16:56:10.439232 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 331/639] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:10 2022] GET /compute/v2.1/servers/9b0acf48-1262-4cbc-98dc-562510f2cc10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:11.211431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-22890325-2c20-4e6a-843a-d4f040d3d2e1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:11.212111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-22890325-2c20-4e6a-843a-d4f040d3d2e1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:11.218490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-22890325-2c20-4e6a-843a-d4f040d3d2e1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:11.219018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-22890325-2c20-4e6a-843a-d4f040d3d2e1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:11.219789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-22890325-2c20-4e6a-843a-d4f040d3d2e1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:11.220219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-22890325-2c20-4e6a-843a-d4f040d3d2e1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:11.243438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-22890325-2c20-4e6a-843a-d4f040d3d2e1 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/ips" status: 200 len: 145 microversion: 2.1 time: 0.035834 Jul 18 16:56:11.244025 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 309/640] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 16:56:11 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:12.968387 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8d177313-b158-48e0-9fd7-e93ebdf317e9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "798bb2d9-ef7f-44f0-b3f2-71836c82cf07"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:12.969649 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8d177313-b158-48e0-9fd7-e93ebdf317e9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:12.976501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8d177313-b158-48e0-9fd7-e93ebdf317e9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:12.976993 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8d177313-b158-48e0-9fd7-e93ebdf317e9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:12.977771 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8d177313-b158-48e0-9fd7-e93ebdf317e9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:12.978233 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8d177313-b158-48e0-9fd7-e93ebdf317e9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.827086 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8d177313-b158-48e0-9fd7-e93ebdf317e9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862517 Jul 18 16:56:13.827987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 332/641] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:56:12 2022] POST /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:19.430170 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6d1247af-de42-4818-b8f8-378f4c85e5bd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1202975513"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:19.430170 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6d1247af-de42-4818-b8f8-378f4c85e5bd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:19.430170 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:19.434957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d1247af-de42-4818-b8f8-378f4c85e5bd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.435406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d1247af-de42-4818-b8f8-378f4c85e5bd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.436171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d1247af-de42-4818-b8f8-378f4c85e5bd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.436600 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d1247af-de42-4818-b8f8-378f4c85e5bd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.605372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.network.security_group_api [None req-6d1247af-de42-4818-b8f8-378f4c85e5bd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Removing security group 3230954e-64b6-4517-8ebb-8055af4c8541 from port 38643ba4-8900-42fa-86db-6a74e9ac1a2e Jul 18 16:56:20.079040 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6d1247af-de42-4818-b8f8-378f4c85e5bd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "POST /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/action" status: 202 len: 0 microversion: 2.1 time: 0.656145 Jul 18 16:56:20.080494 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 310/642] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:56:19 2022] POST /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:20.095988 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-d92339ff-dc5f-45fc-b74e-7abdf500da6d req-c4649307-f3a3-4bf4-bf7a-4df6451997b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f88bfc-2675-40e9-a413-ab95f2b7ad36", "tag": "38643ba4-8900-42fa-86db-6a74e9ac1a2e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:20.106476 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-d92339ff-dc5f-45fc-b74e-7abdf500da6d req-c4649307-f3a3-4bf4-bf7a-4df6451997b2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.107615 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-d92339ff-dc5f-45fc-b74e-7abdf500da6d req-c4649307-f3a3-4bf4-bf7a-4df6451997b2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.133869 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-d92339ff-dc5f-45fc-b74e-7abdf500da6d req-c4649307-f3a3-4bf4-bf7a-4df6451997b2 service nova] Creating event network-changed:38643ba4-8900-42fa-86db-6a74e9ac1a2e for instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 on hv-cinder-84617 Jul 18 16:56:20.141321 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-d92339ff-dc5f-45fc-b74e-7abdf500da6d req-c4649307-f3a3-4bf4-bf7a-4df6451997b2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050217 Jul 18 16:56:20.142162 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 333/643] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:21.405052 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-26bc3ced-c360-4448-a861-e6af918af6fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:21.406064 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-26bc3ced-c360-4448-a861-e6af918af6fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:21.413624 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-26bc3ced-c360-4448-a861-e6af918af6fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.414075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-26bc3ced-c360-4448-a861-e6af918af6fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.422709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-26bc3ced-c360-4448-a861-e6af918af6fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.422709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-26bc3ced-c360-4448-a861-e6af918af6fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.449814 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-26bc3ced-c360-4448-a861-e6af918af6fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048855 Jul 18 16:56:21.451292 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 311/644] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:56:21 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:21.462156 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9503eb55-357c-4792-9399-b138424180fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:21.462742 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9503eb55-357c-4792-9399-b138424180fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:21.472451 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9503eb55-357c-4792-9399-b138424180fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.472958 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9503eb55-357c-4792-9399-b138424180fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.473763 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9503eb55-357c-4792-9399-b138424180fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.474990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9503eb55-357c-4792-9399-b138424180fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.479509 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:21.513921 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9503eb55-357c-4792-9399-b138424180fa tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/798bb2d9-ef7f-44f0-b3f2-71836c82cf07" status: 200 len: 194 microversion: 2.1 time: 0.056065 Jul 18 16:56:21.515118 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 334/645] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 18 16:56:21 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/798bb2d9-ef7f-44f0-b3f2-71836c82cf07 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:22.063183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-43217c09-6fac-4983-857d-0c58742d5f40 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:22.063935 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-43217c09-6fac-4983-857d-0c58742d5f40 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:22.071147 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-43217c09-6fac-4983-857d-0c58742d5f40 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.071856 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-43217c09-6fac-4983-857d-0c58742d5f40 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.072656 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-43217c09-6fac-4983-857d-0c58742d5f40 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.073308 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-43217c09-6fac-4983-857d-0c58742d5f40 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.204056 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-43217c09-6fac-4983-857d-0c58742d5f40 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lazy-loading 'services' on Instance uuid 19f88bfc-2675-40e9-a413-ab95f2b7ad36 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:22.240393 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b41fe49c-e6e7-4d8f-8b35-daa626755263 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'create', calling method: .version_select at 0x7fd4f50b5430>, body: {"keypair": {"name": "tempest-keypair-1961049290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtREwbpyOGXyfK4GBXn0WeybC6tgtv9GVnAfJROhd7kNMZ7Eimi+VhIxheoGEhRSrusLiPsa4xwpAt61mTmdLgdQmrPJzl3iEvXZve3AjpMd727QPb0TjTzAs9USxFk/A=="}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:22.257247 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-b41fe49c-e6e7-4d8f-8b35-daa626755263 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Getting quotas for project 034f143ba31148c0939a06296ec18a96. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:56:22.265942 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-b41fe49c-e6e7-4d8f-8b35-daa626755263 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Getting quotas for user 24b3c774c1b04537a970c1e7dfdd6ac3 and project 034f143ba31148c0939a06296ec18a96. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:56:22.388304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b41fe49c-e6e7-4d8f-8b35-daa626755263 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.361611 Jul 18 16:56:22.389019 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 312/646] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 16:56:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 363 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 16:56:22.394386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-98ef8995-a28f-45cc-b09d-76aad5c55658 req-0b2698ff-1503-47f6-9ffb-13676aa86218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f88bfc-2675-40e9-a413-ab95f2b7ad36", "tag": "38643ba4-8900-42fa-86db-6a74e9ac1a2e"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:22.403734 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-98ef8995-a28f-45cc-b09d-76aad5c55658 req-0b2698ff-1503-47f6-9ffb-13676aa86218 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.404985 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-98ef8995-a28f-45cc-b09d-76aad5c55658 req-0b2698ff-1503-47f6-9ffb-13676aa86218 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.418187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-98ef8995-a28f-45cc-b09d-76aad5c55658 req-0b2698ff-1503-47f6-9ffb-13676aa86218 service nova] Creating event network-changed:38643ba4-8900-42fa-86db-6a74e9ac1a2e for instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 on hv-cinder-84617 Jul 18 16:56:22.427101 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-98ef8995-a28f-45cc-b09d-76aad5c55658 req-0b2698ff-1503-47f6-9ffb-13676aa86218 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036417 Jul 18 16:56:22.432392 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 313/647] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:22.569927 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-43217c09-6fac-4983-857d-0c58742d5f40 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "DELETE /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments/d57d17f9-c203-4420-9b5d-cb278843e813" status: 202 len: 0 microversion: 2.1 time: 0.497618 Jul 18 16:56:22.577079 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 335/648] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:56:22 2022] DELETE /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments/d57d17f9-c203-4420-9b5d-cb278843e813 => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:22.584307 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-66681e7f-cec9-4d67-acd5-58c048852b23 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:22.585939 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-66681e7f-cec9-4d67-acd5-58c048852b23 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:22.603746 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-66681e7f-cec9-4d67-acd5-58c048852b23 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.604281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-66681e7f-cec9-4d67-acd5-58c048852b23 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.605208 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-66681e7f-cec9-4d67-acd5-58c048852b23 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:22.605930 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-66681e7f-cec9-4d67-acd5-58c048852b23 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.677533 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-66681e7f-cec9-4d67-acd5-58c048852b23 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096696 Jul 18 16:56:22.678169 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 314/649] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:56:22 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:23.332577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-204e615d-fb36-4720-a40e-b30329844847 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e579e065-1118-436b-9b91-b935fdc4ae2b"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:23.334044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-204e615d-fb36-4720-a40e-b30329844847 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:23.348505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-204e615d-fb36-4720-a40e-b30329844847 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.350199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-204e615d-fb36-4720-a40e-b30329844847 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.351795 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-204e615d-fb36-4720-a40e-b30329844847 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.352424 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-204e615d-fb36-4720-a40e-b30329844847 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.690694 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2797a4c7-5a19-4172-9e96-6fa0fc837ced tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:23.702784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2797a4c7-5a19-4172-9e96-6fa0fc837ced tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:23.702784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2797a4c7-5a19-4172-9e96-6fa0fc837ced tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.702784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2797a4c7-5a19-4172-9e96-6fa0fc837ced tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.702784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2797a4c7-5a19-4172-9e96-6fa0fc837ced tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.703200 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2797a4c7-5a19-4172-9e96-6fa0fc837ced tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.733069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:23.744175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2797a4c7-5a19-4172-9e96-6fa0fc837ced tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057171 Jul 18 16:56:23.745720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 315/650] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:56:23 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:24.247217 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-204e615d-fb36-4720-a40e-b30329844847 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "POST /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.919665 Jul 18 16:56:24.247922 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 336/651] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:56:23 2022] POST /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments => generated 194 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:24.757453 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0fe3af9b-6bc7-4920-a0a2-920b6caa35fb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:24.758375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0fe3af9b-6bc7-4920-a0a2-920b6caa35fb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:24.766332 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0fe3af9b-6bc7-4920-a0a2-920b6caa35fb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.766776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0fe3af9b-6bc7-4920-a0a2-920b6caa35fb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.768084 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0fe3af9b-6bc7-4920-a0a2-920b6caa35fb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.768511 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0fe3af9b-6bc7-4920-a0a2-920b6caa35fb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.798110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0fe3af9b-6bc7-4920-a0a2-920b6caa35fb tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045261 Jul 18 16:56:24.798713 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 316/652] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:56:24 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:56:24.809996 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:24.810638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:24.817425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.817863 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.818641 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.819111 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.906053 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] HTTP exception thrown: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 is not attached to volume d57d17f9-c203-4420-9b5d-cb278843e813 Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Request method failure captured: Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments/d57d17f9-c203-4420-9b5d-cb278843e813 HTTP/1.1 Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZACS2x4wmc9tXOOT5FPtZ8Bu-A7arbaLQwxEsv7IRNorBLkhsciLfRhv6OdolEoy4lHk4Elztao7iSUAWWZXBPlPWFry5LYxKKhRwvVp3canx2SiWp8Z1g16KUwmAKaK84EhgTDgaZqBIhxDEfa8TuLy28lEKqBHnmiZJ5SupigMA0 Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: a0aa59ff7f5a460daa866b1f3e6dae1a Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-TestMinimumBasicScenario-301542826 Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:56:24.909021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a0aa59ff7f5a460daa866b1f3e6dae1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a0aa59ff7f5a460daa866b1f3e6dae1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a0aa59ff7f5a460daa866b1f3e6dae1a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a0aa59ff7f5a460daa866b1f3e6dae1a"}]}] Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-TestMinimumBasicScenario-301542826 Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: a0aa59ff7f5a460daa866b1f3e6dae1a Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-TestMinimumBasicScenario-301542826 Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-TestMinimumBasicScenario-301542826-project Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: ab4d3667826148d390eda90bb8baf081 Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-TestMinimumBasicScenario-301542826-project Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:56:24.910600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 is not attached to volume d57d17f9-c203-4420-9b5d-cb278843e813 Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'server_id': '19f88bfc-2675-40e9-a413-ab95f2b7ad36', 'id': 'd57d17f9-c203-4420-9b5d-cb278843e813'} Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d57d17f9-c203-4420-9b5d-cb278843e813. Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:24.911305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 is not attached to volume d57d17f9-c203-4420-9b5d-cb278843e813 Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 is not attached to volume d57d17f9-c203-4420-9b5d-cb278843e813 Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:24.912517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Returning 404 to user: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 is not attached to volume d57d17f9-c203-4420-9b5d-cb278843e813 {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:24.915112 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9c8df54a-be14-4872-9eec-a81ce083f528 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "DELETE /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments/d57d17f9-c203-4420-9b5d-cb278843e813" status: 404 len: 154 microversion: 2.1 time: 0.105577 Jul 18 16:56:24.917140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 337/653] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:56:24 2022] DELETE /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36/os-volume_attachments/d57d17f9-c203-4420-9b5d-cb278843e813 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:56:25.085183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-443315270", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "922fd4de-8b18-4999-9d76-f017a470f4a8"}], "security_groups": [{"name": "tempest-securitygroup--645027254"}], "key_name": "tempest-keypair-1961049290", "user_data": "}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:25.206284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] validate_networks() for [('922fd4de-8b18-4999-9d76-f017a470f4a8', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:56:25.725021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:56:25.725857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:56:25.726548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:56:25.727119 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:56:25.727692 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:56:25.739596 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.740222 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.742343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.742984 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.769507 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Getting quotas for project 034f143ba31148c0939a06296ec18a96. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:56:25.774560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Getting quotas for user 24b3c774c1b04537a970c1e7dfdd6ac3 and project 034f143ba31148c0939a06296ec18a96. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:56:25.787699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:56:25.790294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:56:25.926764 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f5656b4c-fae5-4354-8fe0-9fba1246b068 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.846424 Jul 18 16:56:25.932274 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 317/654] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 16:56:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 16:56:25.944108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e68a0f87-cfb1-4462-a6c1-072edde765f3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:25.944928 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e68a0f87-cfb1-4462-a6c1-072edde765f3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:26.014085 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e68a0f87-cfb1-4462-a6c1-072edde765f3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.024530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e68a0f87-cfb1-4462-a6c1-072edde765f3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.026418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e68a0f87-cfb1-4462-a6c1-072edde765f3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.027761 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e68a0f87-cfb1-4462-a6c1-072edde765f3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1281 microversion: 2.20 time: 0.094056 Jul 18 16:56:26.029353 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 338/655] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:25 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:26.184832 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-674c9dfe-4bb2-4cdc-85bc-16e53e9dee0b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:26.185602 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-674c9dfe-4bb2-4cdc-85bc-16e53e9dee0b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:26.192970 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-674c9dfe-4bb2-4cdc-85bc-16e53e9dee0b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.193615 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-674c9dfe-4bb2-4cdc-85bc-16e53e9dee0b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.194580 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-674c9dfe-4bb2-4cdc-85bc-16e53e9dee0b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.195400 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-674c9dfe-4bb2-4cdc-85bc-16e53e9dee0b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.223798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-674c9dfe-4bb2-4cdc-85bc-16e53e9dee0b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:56:26.489940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-674c9dfe-4bb2-4cdc-85bc-16e53e9dee0b tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "DELETE /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 204 len: 0 microversion: 2.1 time: 0.308638 Jul 18 16:56:26.491650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 318/656] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:56:26 2022] DELETE /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:56:26.500290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-18e6c812-4928-4313-95d9-546b274205ad tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:26.512143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-18e6c812-4928-4313-95d9-546b274205ad tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:26.512143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18e6c812-4928-4313-95d9-546b274205ad tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.512143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18e6c812-4928-4313-95d9-546b274205ad tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.512143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18e6c812-4928-4313-95d9-546b274205ad tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.512517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18e6c812-4928-4313-95d9-546b274205ad tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.649319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-18e6c812-4928-4313-95d9-546b274205ad tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.657151 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-18e6c812-4928-4313-95d9-546b274205ad tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1553 microversion: 2.1 time: 0.160998 Jul 18 16:56:26.657823 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 339/657] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:26 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:27.046500 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2dfc767d-f14d-4664-8b1a-89736e753859 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:27.047193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2dfc767d-f14d-4664-8b1a-89736e753859 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:27.102008 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2dfc767d-f14d-4664-8b1a-89736e753859 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.110486 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2dfc767d-f14d-4664-8b1a-89736e753859 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.112766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2dfc767d-f14d-4664-8b1a-89736e753859 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.113967 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2dfc767d-f14d-4664-8b1a-89736e753859 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1281 microversion: 2.20 time: 0.071660 Jul 18 16:56:27.114514 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 319/658] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:27 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:27.675457 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6df8edf1-c3bb-4b88-bd77-2e49e9ebf546 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:27.675983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6df8edf1-c3bb-4b88-bd77-2e49e9ebf546 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:27.682696 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6df8edf1-c3bb-4b88-bd77-2e49e9ebf546 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.683146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6df8edf1-c3bb-4b88-bd77-2e49e9ebf546 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.683919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6df8edf1-c3bb-4b88-bd77-2e49e9ebf546 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.684346 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6df8edf1-c3bb-4b88-bd77-2e49e9ebf546 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.814841 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6df8edf1-c3bb-4b88-bd77-2e49e9ebf546 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.822238 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6df8edf1-c3bb-4b88-bd77-2e49e9ebf546 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1553 microversion: 2.1 time: 0.151265 Jul 18 16:56:27.822793 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 340/659] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:27 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:28.132720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:28.133356 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:28.139905 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.140390 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.141192 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.141636 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.208188 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.216458 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.218091 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.219168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cc426c4c-585e-4a8c-88b3-948c3d4be837 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1285 microversion: 2.20 time: 0.090547 Jul 18 16:56:28.219725 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 320/660] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:28 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:28.840561 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-42990287-da7b-4b4e-a0d7-678e2b850dce tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:28.841521 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-42990287-da7b-4b4e-a0d7-678e2b850dce tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:28.848680 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-42990287-da7b-4b4e-a0d7-678e2b850dce tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.849920 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-42990287-da7b-4b4e-a0d7-678e2b850dce tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.850794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-42990287-da7b-4b4e-a0d7-678e2b850dce tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.851310 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-42990287-da7b-4b4e-a0d7-678e2b850dce tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.985068 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-42990287-da7b-4b4e-a0d7-678e2b850dce tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:28.994025 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-42990287-da7b-4b4e-a0d7-678e2b850dce tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1553 microversion: 2.1 time: 0.156818 Jul 18 16:56:28.996282 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 341/661] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:28 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:29.055801 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-43a4aa7e-196a-451c-94e1-b9b4a35e5973 req-a0edb09d-a242-428a-8f91-6c970f07fd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f88bfc-2675-40e9-a413-ab95f2b7ad36", "name": "network-vif-deleted", "tag": "38643ba4-8900-42fa-86db-6a74e9ac1a2e"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:29.064041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-43a4aa7e-196a-451c-94e1-b9b4a35e5973 req-a0edb09d-a242-428a-8f91-6c970f07fd65 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.069763 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-43a4aa7e-196a-451c-94e1-b9b4a35e5973 req-a0edb09d-a242-428a-8f91-6c970f07fd65 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.075185 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-43a4aa7e-196a-451c-94e1-b9b4a35e5973 req-a0edb09d-a242-428a-8f91-6c970f07fd65 service nova] Creating event network-vif-deleted:38643ba4-8900-42fa-86db-6a74e9ac1a2e for instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 on hv-cinder-84617 Jul 18 16:56:29.080730 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-43a4aa7e-196a-451c-94e1-b9b4a35e5973 req-a0edb09d-a242-428a-8f91-6c970f07fd65 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028714 Jul 18 16:56:29.081366 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 321/662] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:29.238200 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:29.238721 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:29.244926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.245534 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.246307 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.246749 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.313295 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:29.321753 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:29.323266 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:29.324366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-97ca091c-f807-4c70-aaf1-8103b42b07c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1333 microversion: 2.20 time: 0.090809 Jul 18 16:56:29.325190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 342/663] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:29 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:30.013569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:30.014367 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:30.021828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.022565 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.023557 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.023992 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.058442 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.058766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.059102 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lazy-loading 'fault' on Instance uuid 19f88bfc-2675-40e9-a413-ab95f2b7ad36 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:30.216108 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4d3667826148d390eda90bb8baf081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0aa59ff7f5a460daa866b1f3e6dae1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.224973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ad6e2916-36e1-4303-bd39-6af6e01d45d4 tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 200 len: 1347 microversion: 2.1 time: 0.216298 Jul 18 16:56:30.225795 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 322/664] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:30 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 1347 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:30.344015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:30.344642 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:30.352142 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.352589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.353397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.353888 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.423995 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.440462 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.443811 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.445881 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e94a4753-8d4b-4483-aed7-2fb01b06cb99 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1339 microversion: 2.20 time: 0.105589 Jul 18 16:56:30.446894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 343/665] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:30 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:31.242724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:31.243341 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] [instance: 19f88bfc-2675-40e9-a413-ab95f2b7ad36] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:31.249791 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.250233 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.250990 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.251423 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.264467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] HTTP exception thrown: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 could not be found. Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Request method failure captured: Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 HTTP/1.1 Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZACS2x4wmc9tXOOT5FPtZ8Bu-A7arbaLQwxEsv7IRNorBLkhsciLfRhv6OdolEoy4lHk4Elztao7iSUAWWZXBPlPWFry5LYxKKhRwvVp3canx2SiWp8Z1g16KUwmAKaK84EhgTDgaZqBIhxDEfa8TuLy28lEKqBHnmiZJ5SupigMA0 Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: a0aa59ff7f5a460daa866b1f3e6dae1a Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-TestMinimumBasicScenario-301542826 Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:56:31.266105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a0aa59ff7f5a460daa866b1f3e6dae1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a0aa59ff7f5a460daa866b1f3e6dae1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a0aa59ff7f5a460daa866b1f3e6dae1a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a0aa59ff7f5a460daa866b1f3e6dae1a"}]}] Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-TestMinimumBasicScenario-301542826 Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: a0aa59ff7f5a460daa866b1f3e6dae1a Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-TestMinimumBasicScenario-301542826 Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-TestMinimumBasicScenario-301542826-project Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: ab4d3667826148d390eda90bb8baf081 Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-TestMinimumBasicScenario-301542826-project Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 could not be found. Jul 18 16:56:31.268172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '19f88bfc-2675-40e9-a413-ab95f2b7ad36'} Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 could not be found. Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:31.269689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 could not be found. Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 could not be found. Jul 18 16:56:31.271146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:31.272489 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Returning 404 to user: Instance 19f88bfc-2675-40e9-a413-ab95f2b7ad36 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:31.272489 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-26b41c47-35ba-4e59-8435-fc755520ef6e tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36" status: 404 len: 111 microversion: 2.1 time: 0.029119 Jul 18 16:56:31.272489 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 323/666] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:31 2022] GET /compute/v2.1/servers/19f88bfc-2675-40e9-a413-ab95f2b7ad36 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:31.276584 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-52f8f8cc-b4a8-49fd-a75c-6854730e8cfd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] Calling method '.version_select at 0x7fd4f511d160>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:31.369186 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-52f8f8cc-b4a8-49fd-a75c-6854730e8cfd tempest-TestMinimumBasicScenario-301542826 tempest-TestMinimumBasicScenario-301542826-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-481777633" status: 202 len: 0 microversion: 2.1 time: 0.096219 Jul 18 16:56:31.369893 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 344/667] 10.222.0.88 () {58 vars in 1268 bytes} [Mon Jul 18 16:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-481777633 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:31.466030 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:31.466920 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:31.478129 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.479116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.481172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.481629 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.689448 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:31.701202 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:31.708304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:31.709627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-45b04d59-6e68-4da4-b250-5f44c93fb6aa tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.248489 Jul 18 16:56:31.710310 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 324/668] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:31 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:31.844801 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-94576157-75a4-4dc8-b0cc-d9de9fa6d23a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:31.846259 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-94576157-75a4-4dc8-b0cc-d9de9fa6d23a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:31.852835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-94576157-75a4-4dc8-b0cc-d9de9fa6d23a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.853329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-94576157-75a4-4dc8-b0cc-d9de9fa6d23a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.854105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-94576157-75a4-4dc8-b0cc-d9de9fa6d23a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.854555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-94576157-75a4-4dc8-b0cc-d9de9fa6d23a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.885669 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-94576157-75a4-4dc8-b0cc-d9de9fa6d23a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044724 Jul 18 16:56:31.886430 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 345/669] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:56:31 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:32.029951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9aa75fe4-bd3f-4834-8611-7117df5d9c6a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:32.030443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9aa75fe4-bd3f-4834-8611-7117df5d9c6a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:32.037338 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9aa75fe4-bd3f-4834-8611-7117df5d9c6a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.038033 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9aa75fe4-bd3f-4834-8611-7117df5d9c6a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.038819 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9aa75fe4-bd3f-4834-8611-7117df5d9c6a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.039261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9aa75fe4-bd3f-4834-8611-7117df5d9c6a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.074755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9aa75fe4-bd3f-4834-8611-7117df5d9c6a tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/798bb2d9-ef7f-44f0-b3f2-71836c82cf07" status: 200 len: 194 microversion: 2.1 time: 0.048689 Jul 18 16:56:32.076014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 325/670] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 18 16:56:32 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/798bb2d9-ef7f-44f0-b3f2-71836c82cf07 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:32.086369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3ad7873f-1177-453c-be9d-3f4e6dcda989 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:32.086867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3ad7873f-1177-453c-be9d-3f4e6dcda989 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:32.093434 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3ad7873f-1177-453c-be9d-3f4e6dcda989 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.093896 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3ad7873f-1177-453c-be9d-3f4e6dcda989 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.094701 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3ad7873f-1177-453c-be9d-3f4e6dcda989 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.095739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3ad7873f-1177-453c-be9d-3f4e6dcda989 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.187250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-3ad7873f-1177-453c-be9d-3f4e6dcda989 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lazy-loading 'services' on Instance uuid 886b14f7-f670-4e46-b25f-1fd2502c5fce {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:32.221668 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-79572f3f-e9e8-4584-a4d9-94d52c03a1c3 req-f3888004-4ef5-4d10-81a4-03382f6fec1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48753a71-ab88-464c-91fd-21fd8f63c17f", "tag": "b47c20c9-b813-4d4c-a62a-1fe35f9924ca"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:32.237587 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-79572f3f-e9e8-4584-a4d9-94d52c03a1c3 req-f3888004-4ef5-4d10-81a4-03382f6fec1a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.238462 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-79572f3f-e9e8-4584-a4d9-94d52c03a1c3 req-f3888004-4ef5-4d10-81a4-03382f6fec1a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.257285 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-79572f3f-e9e8-4584-a4d9-94d52c03a1c3 req-f3888004-4ef5-4d10-81a4-03382f6fec1a service nova] Creating event network-changed:b47c20c9-b813-4d4c-a62a-1fe35f9924ca for instance 48753a71-ab88-464c-91fd-21fd8f63c17f on hv-cinder-84617 Jul 18 16:56:32.264756 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-79572f3f-e9e8-4584-a4d9-94d52c03a1c3 req-f3888004-4ef5-4d10-81a4-03382f6fec1a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048694 Jul 18 16:56:32.265804 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 326/671] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:32.426161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3ad7873f-1177-453c-be9d-3f4e6dcda989 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/798bb2d9-ef7f-44f0-b3f2-71836c82cf07" status: 202 len: 0 microversion: 2.1 time: 0.343288 Jul 18 16:56:32.426903 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 346/672] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:56:32 2022] DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/798bb2d9-ef7f-44f0-b3f2-71836c82cf07 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:32.727678 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:32.728499 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:32.735103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.736061 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.738105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.738535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.878308 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.886552 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.888059 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.889222 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6329b1b2-fe52-49b5-b087-60770db87b35 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.165848 Jul 18 16:56:32.889784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 327/673] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:32 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:33.908151 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:33.908844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:33.915703 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.916157 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.916969 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.917435 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.088751 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:34.097406 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:34.098947 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:34.100062 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c5487c44-1439-41bb-a4e5-06c4bfa9f4ef tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.196247 Jul 18 16:56:34.100634 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 347/674] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:33 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:34.629229 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fabe4984-dd3e-4a9f-9842-794db98465e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:34.634879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fabe4984-dd3e-4a9f-9842-794db98465e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:34.636607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fabe4984-dd3e-4a9f-9842-794db98465e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.637099 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fabe4984-dd3e-4a9f-9842-794db98465e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.637860 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fabe4984-dd3e-4a9f-9842-794db98465e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.638293 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fabe4984-dd3e-4a9f-9842-794db98465e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.668815 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fabe4984-dd3e-4a9f-9842-794db98465e2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/e579e065-1118-436b-9b91-b935fdc4ae2b" status: 200 len: 194 microversion: 2.1 time: 0.043799 Jul 18 16:56:34.669751 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 328/675] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 18 16:56:34 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/e579e065-1118-436b-9b91-b935fdc4ae2b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:34.680374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b8c41218-8bcc-43a3-9f1a-ad0c95daa6db tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:34.680972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b8c41218-8bcc-43a3-9f1a-ad0c95daa6db tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:34.698589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b8c41218-8bcc-43a3-9f1a-ad0c95daa6db tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.699290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b8c41218-8bcc-43a3-9f1a-ad0c95daa6db tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.700658 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b8c41218-8bcc-43a3-9f1a-ad0c95daa6db tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.701199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b8c41218-8bcc-43a3-9f1a-ad0c95daa6db tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.795199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-b8c41218-8bcc-43a3-9f1a-ad0c95daa6db tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lazy-loading 'services' on Instance uuid 886b14f7-f670-4e46-b25f-1fd2502c5fce {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:35.049106 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b8c41218-8bcc-43a3-9f1a-ad0c95daa6db tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/e579e065-1118-436b-9b91-b935fdc4ae2b" status: 202 len: 0 microversion: 2.1 time: 0.372656 Jul 18 16:56:35.050411 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 348/676] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:56:34 2022] DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments/e579e065-1118-436b-9b91-b935fdc4ae2b => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:35.119149 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:35.120483 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:35.128200 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:35.130674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:35.130674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:35.130674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:35.337600 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:35.346252 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:35.347846 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:35.349227 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-13a97d57-b872-4fd7-b568-1c19ae78361d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.235169 Jul 18 16:56:35.349659 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 329/677] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:35 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:36.025140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:36.030921 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4c392d03-f95c-4e87-8008-3f82da6c9eff tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:36.034323 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4c392d03-f95c-4e87-8008-3f82da6c9eff tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:36.042967 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4c392d03-f95c-4e87-8008-3f82da6c9eff tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.043939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4c392d03-f95c-4e87-8008-3f82da6c9eff tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.044981 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4c392d03-f95c-4e87-8008-3f82da6c9eff tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.045619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4c392d03-f95c-4e87-8008-3f82da6c9eff tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.062143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:36.130816 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4c392d03-f95c-4e87-8008-3f82da6c9eff tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "POST /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6/action" status: 200 len: 14 microversion: 2.1 time: 0.108279 Jul 18 16:56:36.131529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 349/678] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 18 16:56:36 2022] POST /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:56:36.367641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:36.368249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:36.387117 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:36.387117 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.387117 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.387996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.388096 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.650621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.659344 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.661262 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.664739 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b26aaee0-52de-412b-8581-29f1c267d56a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.299830 Jul 18 16:56:36.676156 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 330/679] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:36 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:37.335149 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a7b350c4-6940-49ae-ab45-2e2648b34854 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.336356 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a7b350c4-6940-49ae-ab45-2e2648b34854 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.339150 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:37.346099 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a7b350c4-6940-49ae-ab45-2e2648b34854 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.347439 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a7b350c4-6940-49ae-ab45-2e2648b34854 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.347439 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a7b350c4-6940-49ae-ab45-2e2648b34854 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.347753 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a7b350c4-6940-49ae-ab45-2e2648b34854 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.380718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a7b350c4-6940-49ae-ab45-2e2648b34854 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051272 Jul 18 16:56:37.381368 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 350/680] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:56:37 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:56:37.505529 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-71023590-b060-48f2-b430-8693016038b5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.506454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-71023590-b060-48f2-b430-8693016038b5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.508469 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=12 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:37.514153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-71023590-b060-48f2-b430-8693016038b5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.514602 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-71023590-b060-48f2-b430-8693016038b5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.515374 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-71023590-b060-48f2-b430-8693016038b5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.515799 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-71023590-b060-48f2-b430-8693016038b5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.552285 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-71023590-b060-48f2-b430-8693016038b5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050771 Jul 18 16:56:37.557632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 331/681] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:56:37 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:56:37.625285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ff145085-abb1-49e3-875c-0711ec50676e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.626426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ff145085-abb1-49e3-875c-0711ec50676e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.634336 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ff145085-abb1-49e3-875c-0711ec50676e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.635076 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ff145085-abb1-49e3-875c-0711ec50676e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.636093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ff145085-abb1-49e3-875c-0711ec50676e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.636737 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ff145085-abb1-49e3-875c-0711ec50676e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.666106 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ff145085-abb1-49e3-875c-0711ec50676e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:56:37.684009 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.686032 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.693329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.694053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.694829 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.695543 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.838334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:37.849330 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:37.850944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:37.852116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a87cc495-35dc-4c0a-be30-e8549c759824 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.172439 Jul 18 16:56:37.863594 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 332/682] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:37 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:56:37.870986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e014bc9c-68f6-4791-865e-2e2740e7702b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.871515 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e014bc9c-68f6-4791-865e-2e2740e7702b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.879690 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e014bc9c-68f6-4791-865e-2e2740e7702b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.880068 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e014bc9c-68f6-4791-865e-2e2740e7702b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.881276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e014bc9c-68f6-4791-865e-2e2740e7702b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.881721 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e014bc9c-68f6-4791-865e-2e2740e7702b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.925138 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e014bc9c-68f6-4791-865e-2e2740e7702b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:56:37.949818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:37.975790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ff145085-abb1-49e3-875c-0711ec50676e tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 204 len: 0 microversion: 2.1 time: 0.355146 Jul 18 16:56:37.977105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 351/683] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:56:37 2022] DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:56:38.055306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-c561bdc9-822b-453c-8f48-33f004ec6fb4 req-6901d786-fa5d-4e48-a9d1-f8a510ab115a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5983e4e-fd93-4b05-b152-8c5c488364f6", "tag": "1e587242-bec2-4c2e-ae22-9a164230f521"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:38.069284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-c561bdc9-822b-453c-8f48-33f004ec6fb4 req-6901d786-fa5d-4e48-a9d1-f8a510ab115a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.069893 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-c561bdc9-822b-453c-8f48-33f004ec6fb4 req-6901d786-fa5d-4e48-a9d1-f8a510ab115a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.081738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-c561bdc9-822b-453c-8f48-33f004ec6fb4 req-6901d786-fa5d-4e48-a9d1-f8a510ab115a service nova] Creating event network-changed:1e587242-bec2-4c2e-ae22-9a164230f521 for instance f5983e4e-fd93-4b05-b152-8c5c488364f6 on hv-cinder-84617 Jul 18 16:56:38.087347 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-c561bdc9-822b-453c-8f48-33f004ec6fb4 req-6901d786-fa5d-4e48-a9d1-f8a510ab115a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108716 Jul 18 16:56:38.088349 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 352/684] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:38.093731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1722d9f7-20b0-4414-a197-faa904734fef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:38.094978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1722d9f7-20b0-4414-a197-faa904734fef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:38.105768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1722d9f7-20b0-4414-a197-faa904734fef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.105768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1722d9f7-20b0-4414-a197-faa904734fef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.105768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1722d9f7-20b0-4414-a197-faa904734fef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.105768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1722d9f7-20b0-4414-a197-faa904734fef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.304937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e014bc9c-68f6-4791-865e-2e2740e7702b tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 204 len: 0 microversion: 2.1 time: 0.439890 Jul 18 16:56:38.305801 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 333/685] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:56:37 2022] DELETE /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:56:38.314336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-51e6480c-cfb4-4fd8-b3f8-e2def4577724 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:38.320721 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-51e6480c-cfb4-4fd8-b3f8-e2def4577724 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:38.323147 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-51e6480c-cfb4-4fd8-b3f8-e2def4577724 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.323808 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-51e6480c-cfb4-4fd8-b3f8-e2def4577724 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.324919 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-51e6480c-cfb4-4fd8-b3f8-e2def4577724 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.325828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-51e6480c-cfb4-4fd8-b3f8-e2def4577724 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.344076 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1722d9f7-20b0-4414-a197-faa904734fef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:38.356642 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1722d9f7-20b0-4414-a197-faa904734fef tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1671 microversion: 2.1 time: 0.263803 Jul 18 16:56:38.359741 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 353/686] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:38 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1671 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:38.482132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-51e6480c-cfb4-4fd8-b3f8-e2def4577724 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:38.493494 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-51e6480c-cfb4-4fd8-b3f8-e2def4577724 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1569 microversion: 2.1 time: 0.183131 Jul 18 16:56:38.494120 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 334/687] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:38 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:38.690474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-66856e3d-868f-4695-91f4-e30f69184f5b req-fcdfca4a-bb0d-4e98-afc6-71ac32c91dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48753a71-ab88-464c-91fd-21fd8f63c17f", "name": "network-vif-plugged", "status": "completed", "tag": "b47c20c9-b813-4d4c-a62a-1fe35f9924ca"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:38.699726 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-66856e3d-868f-4695-91f4-e30f69184f5b req-fcdfca4a-bb0d-4e98-afc6-71ac32c91dfc service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.703632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-66856e3d-868f-4695-91f4-e30f69184f5b req-fcdfca4a-bb0d-4e98-afc6-71ac32c91dfc service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.715996 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-66856e3d-868f-4695-91f4-e30f69184f5b req-fcdfca4a-bb0d-4e98-afc6-71ac32c91dfc service nova] Creating event network-vif-plugged:b47c20c9-b813-4d4c-a62a-1fe35f9924ca for instance 48753a71-ab88-464c-91fd-21fd8f63c17f on hv-cinder-84617 Jul 18 16:56:38.722148 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-66856e3d-868f-4695-91f4-e30f69184f5b req-fcdfca4a-bb0d-4e98-afc6-71ac32c91dfc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096232 Jul 18 16:56:38.723071 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 354/688] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:38.872284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:38.873700 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:38.883229 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.883909 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.885063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.885421 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.040179 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:39.048643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:39.050174 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:39.051274 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9e030391-86af-4932-bfa6-599c660bc404 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.184609 Jul 18 16:56:39.051845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 335/689] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:38 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:39.379459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-38809a05-7466-4b27-b370-9ad2940809c2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:39.380364 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-38809a05-7466-4b27-b370-9ad2940809c2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:39.389020 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-38809a05-7466-4b27-b370-9ad2940809c2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.389797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-38809a05-7466-4b27-b370-9ad2940809c2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.390720 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-38809a05-7466-4b27-b370-9ad2940809c2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.392592 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-38809a05-7466-4b27-b370-9ad2940809c2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.511936 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e04524ce-8e71-4dd8-94fb-69716e39b94a tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:39.513036 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e04524ce-8e71-4dd8-94fb-69716e39b94a tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:39.548478 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e04524ce-8e71-4dd8-94fb-69716e39b94a tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.549598 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e04524ce-8e71-4dd8-94fb-69716e39b94a tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.554464 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e04524ce-8e71-4dd8-94fb-69716e39b94a tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.557837 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e04524ce-8e71-4dd8-94fb-69716e39b94a tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.644477 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-38809a05-7466-4b27-b370-9ad2940809c2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:39.664201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-38809a05-7466-4b27-b370-9ad2940809c2 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1671 microversion: 2.1 time: 0.292080 Jul 18 16:56:39.664788 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 355/690] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:39 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1671 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:39.826942 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e04524ce-8e71-4dd8-94fb-69716e39b94a tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:39.834884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e04524ce-8e71-4dd8-94fb-69716e39b94a tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1569 microversion: 2.1 time: 0.326983 Jul 18 16:56:39.835665 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 336/691] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:39 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1569 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:40.069441 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:40.070145 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:40.076608 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.077175 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.078016 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.078529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.379577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:40.392558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:40.395611 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:40.397677 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-641f8fe5-0571-4109-8499-7db32003625f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.331919 Jul 18 16:56:40.398678 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 356/692] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:40 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:40.684617 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4e12e1f5-1dce-4af2-9998-7deee949fe71 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:40.686511 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4e12e1f5-1dce-4af2-9998-7deee949fe71 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:40.695650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e12e1f5-1dce-4af2-9998-7deee949fe71 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.696545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e12e1f5-1dce-4af2-9998-7deee949fe71 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.697671 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e12e1f5-1dce-4af2-9998-7deee949fe71 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.698745 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4e12e1f5-1dce-4af2-9998-7deee949fe71 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.853179 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c2323fef-f2f4-4d51-9c3d-c935aea18c20 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:40.853908 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c2323fef-f2f4-4d51-9c3d-c935aea18c20 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:40.863125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c2323fef-f2f4-4d51-9c3d-c935aea18c20 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.863668 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c2323fef-f2f4-4d51-9c3d-c935aea18c20 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.864544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c2323fef-f2f4-4d51-9c3d-c935aea18c20 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.865118 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c2323fef-f2f4-4d51-9c3d-c935aea18c20 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.964832 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4e12e1f5-1dce-4af2-9998-7deee949fe71 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:40.974089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4e12e1f5-1dce-4af2-9998-7deee949fe71 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1671 microversion: 2.1 time: 0.296290 Jul 18 16:56:40.974679 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 337/693] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:40 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1671 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:41.030690 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c2323fef-f2f4-4d51-9c3d-c935aea18c20 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:41.039225 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c2323fef-f2f4-4d51-9c3d-c935aea18c20 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1569 microversion: 2.1 time: 0.190268 Jul 18 16:56:41.044298 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 357/694] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:40 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:41.418066 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:41.419165 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:41.427146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.428008 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.429045 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.429722 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.993038 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-12744784-ef03-42ca-804b-faa12d9504a5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:41.994325 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-12744784-ef03-42ca-804b-faa12d9504a5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:42.004387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.004953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-12744784-ef03-42ca-804b-faa12d9504a5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.005215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-12744784-ef03-42ca-804b-faa12d9504a5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.007022 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-12744784-ef03-42ca-804b-faa12d9504a5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.007514 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-12744784-ef03-42ca-804b-faa12d9504a5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.017995 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.021024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.022531 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-874c3de7-d6d1-41cd-863a-9cfc589a7506 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.608981 Jul 18 16:56:42.023032 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 338/695] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:41 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:42.057325 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0e24d7ac-b548-4f10-bde5-5aa3d29a3b2e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:42.057926 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0e24d7ac-b548-4f10-bde5-5aa3d29a3b2e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:42.061075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:42.068374 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e24d7ac-b548-4f10-bde5-5aa3d29a3b2e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.069061 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e24d7ac-b548-4f10-bde5-5aa3d29a3b2e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.070217 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e24d7ac-b548-4f10-bde5-5aa3d29a3b2e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.070995 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0e24d7ac-b548-4f10-bde5-5aa3d29a3b2e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.196366 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0e24d7ac-b548-4f10-bde5-5aa3d29a3b2e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.199305 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-12744784-ef03-42ca-804b-faa12d9504a5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.205524 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0e24d7ac-b548-4f10-bde5-5aa3d29a3b2e tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1501 microversion: 2.1 time: 0.151539 Jul 18 16:56:42.211941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-12744784-ef03-42ca-804b-faa12d9504a5 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1671 microversion: 2.1 time: 0.224118 Jul 18 16:56:42.213137 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 358/696] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:41 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:42.215343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 339/697] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:42 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:42.220002 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-07c00285-2c94-4ac9-ae24-349ed12bb9b6 req-964c8ea5-6ef5-4c6b-9e75-8f56aa3e7f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5983e4e-fd93-4b05-b152-8c5c488364f6", "name": "network-vif-deleted", "tag": "1e587242-bec2-4c2e-ae22-9a164230f521"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:42.231118 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-07c00285-2c94-4ac9-ae24-349ed12bb9b6 req-964c8ea5-6ef5-4c6b-9e75-8f56aa3e7f2d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.231760 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-07c00285-2c94-4ac9-ae24-349ed12bb9b6 req-964c8ea5-6ef5-4c6b-9e75-8f56aa3e7f2d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.243863 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-07c00285-2c94-4ac9-ae24-349ed12bb9b6 req-964c8ea5-6ef5-4c6b-9e75-8f56aa3e7f2d service nova] Creating event network-vif-deleted:1e587242-bec2-4c2e-ae22-9a164230f521 for instance f5983e4e-fd93-4b05-b152-8c5c488364f6 on hv-cinder-84617 Jul 18 16:56:42.248819 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-07c00285-2c94-4ac9-ae24-349ed12bb9b6 req-964c8ea5-6ef5-4c6b-9e75-8f56aa3e7f2d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034235 Jul 18 16:56:42.254048 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 359/698] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:42.456110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-5ae77a9d-a385-4742-86ca-38385f1e63df req-52420321-7cb3-4d4b-87a3-3715deb6c551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886b14f7-f670-4e46-b25f-1fd2502c5fce", "name": "network-vif-unplugged", "status": "completed", "tag": "c8f5dcd2-0154-47c8-a079-036b5cc45157"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:42.466291 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-5ae77a9d-a385-4742-86ca-38385f1e63df req-52420321-7cb3-4d4b-87a3-3715deb6c551 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.466888 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-5ae77a9d-a385-4742-86ca-38385f1e63df req-52420321-7cb3-4d4b-87a3-3715deb6c551 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.479284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-5ae77a9d-a385-4742-86ca-38385f1e63df req-52420321-7cb3-4d4b-87a3-3715deb6c551 service nova] Creating event network-vif-unplugged:c8f5dcd2-0154-47c8-a079-036b5cc45157 for instance 886b14f7-f670-4e46-b25f-1fd2502c5fce on hv-cinder-84617 Jul 18 16:56:42.484162 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-5ae77a9d-a385-4742-86ca-38385f1e63df req-52420321-7cb3-4d4b-87a3-3715deb6c551 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037979 Jul 18 16:56:42.484764 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 340/699] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:43.043066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:43.043709 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:43.051536 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.052030 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.052814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.053300 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.212934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:43.230053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1fe0abfe-7974-4b6b-b091-5c70b6877ae2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:43.233325 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1fe0abfe-7974-4b6b-b091-5c70b6877ae2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:43.241639 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1fe0abfe-7974-4b6b-b091-5c70b6877ae2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.242252 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1fe0abfe-7974-4b6b-b091-5c70b6877ae2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.243210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1fe0abfe-7974-4b6b-b091-5c70b6877ae2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.243643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1fe0abfe-7974-4b6b-b091-5c70b6877ae2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.244387 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:43.247138 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:43.251624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-dc2776e8-d2e4-42b7-9492-81e5e48599d6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1406 microversion: 2.20 time: 0.213598 Jul 18 16:56:43.252617 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 360/700] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:43 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:43.258705 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4f80a11a-8425-4a8e-8968-c3f7a6db2f69 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:43.259694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4f80a11a-8425-4a8e-8968-c3f7a6db2f69 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:43.267290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4f80a11a-8425-4a8e-8968-c3f7a6db2f69 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.268150 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4f80a11a-8425-4a8e-8968-c3f7a6db2f69 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.269180 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4f80a11a-8425-4a8e-8968-c3f7a6db2f69 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.269826 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4f80a11a-8425-4a8e-8968-c3f7a6db2f69 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.400467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1fe0abfe-7974-4b6b-b091-5c70b6877ae2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:43.412102 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1fe0abfe-7974-4b6b-b091-5c70b6877ae2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1384 microversion: 2.1 time: 0.188543 Jul 18 16:56:43.414874 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 341/701] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:43 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1384 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:43.444023 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-fb1d50a5-3ffc-413f-a0d0-506ef2998972 req-58844a73-d96b-4d60-8422-0afc36fa4819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886b14f7-f670-4e46-b25f-1fd2502c5fce", "name": "network-vif-deleted", "tag": "c8f5dcd2-0154-47c8-a079-036b5cc45157"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:43.461072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-fb1d50a5-3ffc-413f-a0d0-506ef2998972 req-58844a73-d96b-4d60-8422-0afc36fa4819 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.461813 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-fb1d50a5-3ffc-413f-a0d0-506ef2998972 req-58844a73-d96b-4d60-8422-0afc36fa4819 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.488339 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-fb1d50a5-3ffc-413f-a0d0-506ef2998972 req-58844a73-d96b-4d60-8422-0afc36fa4819 service nova] Creating event network-vif-deleted:c8f5dcd2-0154-47c8-a079-036b5cc45157 for instance 886b14f7-f670-4e46-b25f-1fd2502c5fce on hv-cinder-84617 Jul 18 16:56:43.498714 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-fb1d50a5-3ffc-413f-a0d0-506ef2998972 req-58844a73-d96b-4d60-8422-0afc36fa4819 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058740 Jul 18 16:56:43.499937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 342/702] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:56:43.639865 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4f80a11a-8425-4a8e-8968-c3f7a6db2f69 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:43.648658 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4f80a11a-8425-4a8e-8968-c3f7a6db2f69 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1604 microversion: 2.1 time: 0.394683 Jul 18 16:56:43.650260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 361/703] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:43 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1604 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:44.273048 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:44.274281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:44.281063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.281518 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.282297 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.282797 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.443224 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:44.444532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:44.445278 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:44.456690 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:44.465135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:44.465135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6724d9b7-3c26-491f-ade2-9d0d15438ae5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1598 microversion: 2.20 time: 0.193637 Jul 18 16:56:44.465135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 343/704] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:56:44 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:56:44.468794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.469459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.470076 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.470507 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.485555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e1683484-c4cc-42ad-9be8-ac4cefe828f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:44.486075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e1683484-c4cc-42ad-9be8-ac4cefe828f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:44.494176 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e1683484-c4cc-42ad-9be8-ac4cefe828f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.494633 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e1683484-c4cc-42ad-9be8-ac4cefe828f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.495566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e1683484-c4cc-42ad-9be8-ac4cefe828f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.496015 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e1683484-c4cc-42ad-9be8-ac4cefe828f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.513393 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.513960 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.514419 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lazy-loading 'fault' on Instance uuid f5983e4e-fd93-4b05-b152-8c5c488364f6 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:44.564166 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8016e561397f4b4faca9e03343d51355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2c4fb7f354179a90bfa7d963aa50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:44.571800 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-70e32b19-b177-436a-8d13-72f710578009 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 200 len: 1389 microversion: 2.1 time: 0.144039 Jul 18 16:56:44.572389 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 362/705] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:44 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 1389 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:44.585996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e1683484-c4cc-42ad-9be8-ac4cefe828f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104755 Jul 18 16:56:44.586591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 344/706] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 16:56:44 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:56:44.667486 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:44.668218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:44.675197 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.675752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.676731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.677349 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.711055 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.711511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.711994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lazy-loading 'fault' on Instance uuid 886b14f7-f670-4e46-b25f-1fd2502c5fce {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:56:44.777093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6890f2e62cfd46999791d4a10a81f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bca7eae3a348069131e97b048412b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:44.827322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0237c49b-b906-4a88-8769-6f091dfa894f tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 200 len: 1326 microversion: 2.1 time: 0.163687 Jul 18 16:56:44.828199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 363/707] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:44 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:45.592439 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:45.594172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] [instance: f5983e4e-fd93-4b05-b152-8c5c488364f6] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:45.602478 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:45.602938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:45.604696 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:45.605186 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:45.626702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] HTTP exception thrown: Instance f5983e4e-fd93-4b05-b152-8c5c488364f6 could not be found. Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Request method failure captured: Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 HTTP/1.1 Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y-ZreotQDlNYIROPUY2BBcUsC1hICd5eGNy0JE8op1f0rmSIxDSd5hze48ZJEFbK5TED5-lry3H99NH-08Dagwvk7f-_4mH4nw9l0czY1bkJkWCmg_580dJMwYDPaHbUOTK7fwi-pcZlvqqFqw-F-RFsqa-HVQlPcjCZbjXc3izM-U Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: e3e2c4fb7f354179a90bfa7d963aa50c Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-TestShelveInstance-433510642 Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:56:45.628621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e3e2c4fb7f354179a90bfa7d963aa50c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3e2c4fb7f354179a90bfa7d963aa50c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e3e2c4fb7f354179a90bfa7d963aa50c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3e2c4fb7f354179a90bfa7d963aa50c"}]}] Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-TestShelveInstance-433510642 Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: e3e2c4fb7f354179a90bfa7d963aa50c Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-TestShelveInstance-433510642 Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-TestShelveInstance-433510642-project Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 8016e561397f4b4faca9e03343d51355 Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-TestShelveInstance-433510642-project Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance f5983e4e-fd93-4b05-b152-8c5c488364f6 could not be found. Jul 18 16:56:45.630109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': 'f5983e4e-fd93-4b05-b152-8c5c488364f6'} Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5983e4e-fd93-4b05-b152-8c5c488364f6 could not be found. Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:45.630941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5983e4e-fd93-4b05-b152-8c5c488364f6 could not be found. Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5983e4e-fd93-4b05-b152-8c5c488364f6 could not be found. Jul 18 16:56:45.636018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.638621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Returning 404 to user: Instance f5983e4e-fd93-4b05-b152-8c5c488364f6 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:45.638621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-283015cb-52f1-43e9-94fc-bf8af7f9c2b2 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6" status: 404 len: 111 microversion: 2.1 time: 0.043076 Jul 18 16:56:45.638621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 345/708] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:45 2022] GET /compute/v2.1/servers/f5983e4e-fd93-4b05-b152-8c5c488364f6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:45.844901 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:45.845505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:45.852202 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:45.852650 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:45.853472 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:45.853907 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:45.871404 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] HTTP exception thrown: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Request method failure captured: Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce HTTP/1.1 Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y9ElSq7L7dhSD5K40Y3KQ_wF7s8ffRQq3Uwf4NLohJOtjrYUbZvJYfE9whfF-VWno5XjrwKglgJrr9IJv0B15Wy99Jg_6h1TczpXAUGbgNdVOUKoeOXZjZRIDhKK7UlbKG7D0wb5zyI2z-Gh-70ocZlKiUe14uEP-0jJ49Ggsm3ceo Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:56:45.873141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e8bca7eae3a348069131e97b048412b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}] Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 6890f2e62cfd46999791d4a10a81f95c Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:45.874974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '886b14f7-f670-4e46-b25f-1fd2502c5fce'} Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:45.876183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:45.878363 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:45.881670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Returning 404 to user: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:45.881670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8c7b7904-9e2e-4a0e-b568-7289cb95cdad tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 404 len: 111 microversion: 2.1 time: 0.034141 Jul 18 16:56:45.881670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 364/709] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:45 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:45.882086 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c70c4b19-492a-4b41-b0f6-a3967c146278 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] Calling method '.version_select at 0x7fd4f53898b0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:45.883912 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-eeb7f296-1dab-4206-92ec-336c1f168b38 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '.version_select at 0x7fd4f51a45e0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:45.952022 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-eeb7f296-1dab-4206-92ec-336c1f168b38 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24595641" status: 202 len: 0 microversion: 2.1 time: 0.071775 Jul 18 16:56:45.952776 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 365/710] 10.222.0.88 () {58 vars in 1214 bytes} [Mon Jul 18 16:56:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24595641 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:56:45.968911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c70c4b19-492a-4b41-b0f6-a3967c146278 tempest-TestShelveInstance-433510642 tempest-TestShelveInstance-433510642-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1419738871" status: 202 len: 0 microversion: 2.1 time: 0.097725 Jul 18 16:56:45.970723 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 346/711] 10.222.0.88 () {58 vars in 1253 bytes} [Mon Jul 18 16:56:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1419738871 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:56:46.054731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-c02f59eb-544e-4de5-a370-8bd70ca66207 req-d7785501-1a9d-4571-a458-bcd2d9c2b775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48753a71-ab88-464c-91fd-21fd8f63c17f", "tag": "b47c20c9-b813-4d4c-a62a-1fe35f9924ca"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:56:46.063534 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-c02f59eb-544e-4de5-a370-8bd70ca66207 req-d7785501-1a9d-4571-a458-bcd2d9c2b775 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.066073 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-c02f59eb-544e-4de5-a370-8bd70ca66207 req-d7785501-1a9d-4571-a458-bcd2d9c2b775 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.077928 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-c02f59eb-544e-4de5-a370-8bd70ca66207 req-d7785501-1a9d-4571-a458-bcd2d9c2b775 service nova] Creating event network-changed:b47c20c9-b813-4d4c-a62a-1fe35f9924ca for instance 48753a71-ab88-464c-91fd-21fd8f63c17f on hv-cinder-84617 Jul 18 16:56:46.084457 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-c02f59eb-544e-4de5-a370-8bd70ca66207 req-d7785501-1a9d-4571-a458-bcd2d9c2b775 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033420 Jul 18 16:56:46.088496 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 366/712] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:56:49.725832 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:49.726967 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:49.733220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.734221 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.735689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.737109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.752042 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] HTTP exception thrown: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Request method failure captured: Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce HTTP/1.1 Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y9ElSq7L7dhSD5K40Y3KQ_wF7s8ffRQq3Uwf4NLohJOtjrYUbZvJYfE9whfF-VWno5XjrwKglgJrr9IJv0B15Wy99Jg_6h1TczpXAUGbgNdVOUKoeOXZjZRIDhKK7UlbKG7D0wb5zyI2z-Gh-70ocZlKiUe14uEP-0jJ49Ggsm3ceo Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:56:49.753620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e8bca7eae3a348069131e97b048412b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}] Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 6890f2e62cfd46999791d4a10a81f95c Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.755109 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '886b14f7-f670-4e46-b25f-1fd2502c5fce'} Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:49.755879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.757677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.759416 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Returning 404 to user: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:49.759416 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-40a753db-7118-4cbc-b142-c727c6dab2fb tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 404 len: 111 microversion: 2.1 time: 0.034200 Jul 18 16:56:49.759416 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 347/713] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:56:49 2022] DELETE /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:49.765866 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:49.766611 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: 886b14f7-f670-4e46-b25f-1fd2502c5fce] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:49.773322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.773783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.774621 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.775005 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.790531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] HTTP exception thrown: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Request method failure captured: Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce HTTP/1.1 Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y9ElSq7L7dhSD5K40Y3KQ_wF7s8ffRQq3Uwf4NLohJOtjrYUbZvJYfE9whfF-VWno5XjrwKglgJrr9IJv0B15Wy99Jg_6h1TczpXAUGbgNdVOUKoeOXZjZRIDhKK7UlbKG7D0wb5zyI2z-Gh-70ocZlKiUe14uEP-0jJ49Ggsm3ceo Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:56:49.792215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e8bca7eae3a348069131e97b048412b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}] Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 6890f2e62cfd46999791d4a10a81f95c Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.793809 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '886b14f7-f670-4e46-b25f-1fd2502c5fce'} Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:49.794654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. Jul 18 16:56:49.796124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:49.797769 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Returning 404 to user: Instance 886b14f7-f670-4e46-b25f-1fd2502c5fce could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:49.797769 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a1ccd9c8-a561-4fca-9a9a-d904fafce5c9 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce" status: 404 len: 111 microversion: 2.1 time: 0.033023 Jul 18 16:56:49.797769 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 367/714] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:49 2022] GET /compute/v2.1/servers/886b14f7-f670-4e46-b25f-1fd2502c5fce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:51.185709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:51.186276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:51.193415 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.193872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.194653 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.195092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.209665 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] HTTP exception thrown: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Request method failure captured: Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: DELETE /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee HTTP/1.1 Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1Y9ElSq7L7dhSD5K40Y3KQ_wF7s8ffRQq3Uwf4NLohJOtjrYUbZvJYfE9whfF-VWno5XjrwKglgJrr9IJv0B15Wy99Jg_6h1TczpXAUGbgNdVOUKoeOXZjZRIDhKK7UlbKG7D0wb5zyI2z-Gh-70ocZlKiUe14uEP-0jJ49Ggsm3ceo Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:56:51.211220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e8bca7eae3a348069131e97b048412b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}] Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 6890f2e62cfd46999791d4a10a81f95c Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.212569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': 'e67187e3-9b84-4393-a7bf-c15db8b715ee'} Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:51.213752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.215103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.216827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Returning 404 to user: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:51.216827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cdb86bd5-14bd-4200-92e1-d0ce1f9119a6 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 404 len: 111 microversion: 2.1 time: 0.030746 Jul 18 16:56:51.216827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 348/715] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:56:51 2022] DELETE /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:51.222253 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:51.222971 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] [instance: e67187e3-9b84-4393-a7bf-c15db8b715ee] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:51.229602 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.233129 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.233129 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.233129 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.245579 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] HTTP exception thrown: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Request method failure captured: Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee HTTP/1.1 Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1Y9ElSq7L7dhSD5K40Y3KQ_wF7s8ffRQq3Uwf4NLohJOtjrYUbZvJYfE9whfF-VWno5XjrwKglgJrr9IJv0B15Wy99Jg_6h1TczpXAUGbgNdVOUKoeOXZjZRIDhKK7UlbKG7D0wb5zyI2z-Gh-70ocZlKiUe14uEP-0jJ49Ggsm3ceo Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:56:51.247031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e8bca7eae3a348069131e97b048412b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e8bca7eae3a348069131e97b048412b5"}]}] Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: e8bca7eae3a348069131e97b048412b5 Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeTestJSON-960760167 Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 6890f2e62cfd46999791d4a10a81f95c Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeTestJSON-960760167-project Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.248623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': 'e67187e3-9b84-4393-a7bf-c15db8b715ee'} Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:56:51.249558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. Jul 18 16:56:51.251329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:56:51.253407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] Returning 404 to user: Instance e67187e3-9b84-4393-a7bf-c15db8b715ee could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:56:51.256265 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4139f479-ccda-426c-9359-a4a0303a8af8 tempest-AttachVolumeTestJSON-960760167 tempest-AttachVolumeTestJSON-960760167-project] 10.222.0.88 "GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee" status: 404 len: 111 microversion: 2.1 time: 0.036533 Jul 18 16:56:51.256265 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 368/716] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:51 2022] GET /compute/v2.1/servers/e67187e3-9b84-4393-a7bf-c15db8b715ee => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:57:03.096382 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:03.097183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:03.224475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9787d79f-eb3b-4891-877a-5f10b8269642 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: .version_select at 0x7fd4f53ca3a0>, body: {"keypair": {"name": "tempest-keypair-838582699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf/5pJPj6VvvMr983CzQr6vqIvTnEFKLt7mqWJLsJVV+au+CaUbetd+vgzpbD6ZsucvDjylo1P9joD6raiCK3WCByFQTwmdpAK1ZT8mrWD1XL9/3Z0+BOnJxYTagEl7RQ=="}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:03.238943 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-9787d79f-eb3b-4891-877a-5f10b8269642 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for project 25de8ee0667645a3864d846675d460e1. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:57:03.242707 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-9787d79f-eb3b-4891-877a-5f10b8269642 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for user 730d6426b4ee4cf38893fe2e60b97230 and project 25de8ee0667645a3864d846675d460e1. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:57:03.334105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9787d79f-eb3b-4891-877a-5f10b8269642 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249222 Jul 18 16:57:03.334710 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 349/717] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:57:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:05.717270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-844545479", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9ef866c-b807-4e8d-a4b6-a34e3d904b55"}], "security_groups": [{"name": "tempest-securitygroup--455166296"}], "key_name": "tempest-keypair-838582699", "user_data": "}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:05.724812 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:05.729794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:05.841869 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] validate_networks() for [('a9ef866c-b807-4e8d-a4b6-a34e3d904b55', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:57:06.296670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:57:06.297147 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:57:06.297628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:57:06.298048 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:57:06.298466 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:57:06.307822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:06.308279 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:06.309130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:06.309577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:06.328545 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for project 25de8ee0667645a3864d846675d460e1. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:57:06.332948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for user 730d6426b4ee4cf38893fe2e60b97230 and project 25de8ee0667645a3864d846675d460e1. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:57:06.345539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:57:06.347814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:57:06.499501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c3c5b50e-2fb5-47d2-8a83-d57d2458682a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.786539 Jul 18 16:57:06.500264 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 369/718] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:57:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:57:06.512660 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3d1bf173-d0ed-4823-b42b-6de882ad1786 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:06.513316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3d1bf173-d0ed-4823-b42b-6de882ad1786 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:06.574360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3d1bf173-d0ed-4823-b42b-6de882ad1786 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:06.582301 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3d1bf173-d0ed-4823-b42b-6de882ad1786 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1240 microversion: 2.1 time: 0.074269 Jul 18 16:57:06.582893 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 350/719] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:06 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:07.601328 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-79aa184d-fa3d-4c61-859c-680fa56934b2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:07.601991 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-79aa184d-fa3d-4c61-859c-680fa56934b2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:07.610572 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-79aa184d-fa3d-4c61-859c-680fa56934b2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:07.611031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-79aa184d-fa3d-4c61-859c-680fa56934b2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:07.615110 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-79aa184d-fa3d-4c61-859c-680fa56934b2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:07.615110 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-79aa184d-fa3d-4c61-859c-680fa56934b2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:07.681085 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-79aa184d-fa3d-4c61-859c-680fa56934b2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:07.688552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-79aa184d-fa3d-4c61-859c-680fa56934b2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1244 microversion: 2.1 time: 0.092205 Jul 18 16:57:07.689315 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 370/720] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:07 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:08.705918 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-53dea705-e959-4ead-af7a-c9a3c2a692af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:08.706513 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-53dea705-e959-4ead-af7a-c9a3c2a692af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:08.713197 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53dea705-e959-4ead-af7a-c9a3c2a692af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:08.713652 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53dea705-e959-4ead-af7a-c9a3c2a692af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:08.714440 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53dea705-e959-4ead-af7a-c9a3c2a692af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:08.714880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53dea705-e959-4ead-af7a-c9a3c2a692af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:08.812724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-53dea705-e959-4ead-af7a-c9a3c2a692af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:08.821128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-53dea705-e959-4ead-af7a-c9a3c2a692af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1300 microversion: 2.1 time: 0.119056 Jul 18 16:57:08.822019 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 351/721] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:08 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:09.839674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6da334f8-f38a-4c24-88de-3805d1ac68a8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:09.840227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6da334f8-f38a-4c24-88de-3805d1ac68a8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:09.848680 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6da334f8-f38a-4c24-88de-3805d1ac68a8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.851583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6da334f8-f38a-4c24-88de-3805d1ac68a8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.851583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6da334f8-f38a-4c24-88de-3805d1ac68a8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.851583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6da334f8-f38a-4c24-88de-3805d1ac68a8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.987908 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-6da334f8-f38a-4c24-88de-3805d1ac68a8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:09.995405 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6da334f8-f38a-4c24-88de-3805d1ac68a8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1365 microversion: 2.1 time: 0.159661 Jul 18 16:57:09.996066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 371/722] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:09 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:10.500777 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-50f127d9-f705-4b7a-9492-7eb14c1b4db2 req-e1b8d79d-0747-45c1-8ce9-f985b8d541cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2733168d-74ec-4dac-a804-6a9f03c2d409", "tag": "2ef11d7b-f237-4db2-a52b-57493a3fb7c8"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:10.513859 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-50f127d9-f705-4b7a-9492-7eb14c1b4db2 req-e1b8d79d-0747-45c1-8ce9-f985b8d541cd service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:10.514174 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-50f127d9-f705-4b7a-9492-7eb14c1b4db2 req-e1b8d79d-0747-45c1-8ce9-f985b8d541cd service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:10.527062 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-50f127d9-f705-4b7a-9492-7eb14c1b4db2 req-e1b8d79d-0747-45c1-8ce9-f985b8d541cd service nova] Creating event network-changed:2ef11d7b-f237-4db2-a52b-57493a3fb7c8 for instance 2733168d-74ec-4dac-a804-6a9f03c2d409 on hv-cinder-84617 Jul 18 16:57:10.533245 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-50f127d9-f705-4b7a-9492-7eb14c1b4db2 req-e1b8d79d-0747-45c1-8ce9-f985b8d541cd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035754 Jul 18 16:57:10.534037 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 352/723] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:11.013196 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3dffd869-3eff-4047-9d0c-9060c53057b0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:11.013894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3dffd869-3eff-4047-9d0c-9060c53057b0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:11.020724 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3dffd869-3eff-4047-9d0c-9060c53057b0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:11.021205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3dffd869-3eff-4047-9d0c-9060c53057b0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:11.021974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3dffd869-3eff-4047-9d0c-9060c53057b0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:11.022408 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3dffd869-3eff-4047-9d0c-9060c53057b0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:11.154381 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3dffd869-3eff-4047-9d0c-9060c53057b0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:11.161828 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3dffd869-3eff-4047-9d0c-9060c53057b0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1365 microversion: 2.1 time: 0.152498 Jul 18 16:57:11.162409 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 372/724] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:11 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:12.179802 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c79eb577-6f26-4680-b263-84c94dbcb65b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:12.180463 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c79eb577-6f26-4680-b263-84c94dbcb65b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:12.186659 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c79eb577-6f26-4680-b263-84c94dbcb65b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:12.187075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c79eb577-6f26-4680-b263-84c94dbcb65b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:12.188644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c79eb577-6f26-4680-b263-84c94dbcb65b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:12.189117 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c79eb577-6f26-4680-b263-84c94dbcb65b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:12.322689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c79eb577-6f26-4680-b263-84c94dbcb65b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:12.331064 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c79eb577-6f26-4680-b263-84c94dbcb65b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1365 microversion: 2.1 time: 0.156027 Jul 18 16:57:12.331629 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 353/725] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:12 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:13.348108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-789a7629-5c24-4ecf-bcde-66294891905b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:13.348720 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-789a7629-5c24-4ecf-bcde-66294891905b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:13.355490 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-789a7629-5c24-4ecf-bcde-66294891905b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:13.355944 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-789a7629-5c24-4ecf-bcde-66294891905b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:13.356721 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-789a7629-5c24-4ecf-bcde-66294891905b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:13.357183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-789a7629-5c24-4ecf-bcde-66294891905b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:13.490214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-789a7629-5c24-4ecf-bcde-66294891905b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:13.497739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-789a7629-5c24-4ecf-bcde-66294891905b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1365 microversion: 2.1 time: 0.154058 Jul 18 16:57:13.498309 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 373/726] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:13 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:14.514617 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-131738b1-362e-4696-8935-1a2900817034 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:14.516190 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-131738b1-362e-4696-8935-1a2900817034 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:14.522816 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-131738b1-362e-4696-8935-1a2900817034 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.523245 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-131738b1-362e-4696-8935-1a2900817034 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.523997 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-131738b1-362e-4696-8935-1a2900817034 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.524686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-131738b1-362e-4696-8935-1a2900817034 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.662802 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-131738b1-362e-4696-8935-1a2900817034 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:14.670320 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-131738b1-362e-4696-8935-1a2900817034 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1365 microversion: 2.1 time: 0.159497 Jul 18 16:57:14.671128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 354/727] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:14 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:14.692285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-b3eeed16-497c-46e2-b0f9-29901358dbe8 req-a6be5125-4db9-46b4-9553-0800b14bf5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2733168d-74ec-4dac-a804-6a9f03c2d409", "name": "network-vif-plugged", "status": "completed", "tag": "2ef11d7b-f237-4db2-a52b-57493a3fb7c8"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:14.700589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-b3eeed16-497c-46e2-b0f9-29901358dbe8 req-a6be5125-4db9-46b4-9553-0800b14bf5bb service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.701071 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-b3eeed16-497c-46e2-b0f9-29901358dbe8 req-a6be5125-4db9-46b4-9553-0800b14bf5bb service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.712438 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-b3eeed16-497c-46e2-b0f9-29901358dbe8 req-a6be5125-4db9-46b4-9553-0800b14bf5bb service nova] Creating event network-vif-plugged:2ef11d7b-f237-4db2-a52b-57493a3fb7c8 for instance 2733168d-74ec-4dac-a804-6a9f03c2d409 on hv-cinder-84617 Jul 18 16:57:14.717383 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-b3eeed16-497c-46e2-b0f9-29901358dbe8 req-a6be5125-4db9-46b4-9553-0800b14bf5bb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029828 Jul 18 16:57:14.717965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 374/728] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:15.687631 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-00bb2989-204d-40e5-afcb-04bfc0420797 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:15.688241 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-00bb2989-204d-40e5-afcb-04bfc0420797 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:15.694412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00bb2989-204d-40e5-afcb-04bfc0420797 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:15.694855 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00bb2989-204d-40e5-afcb-04bfc0420797 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:15.695613 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00bb2989-204d-40e5-afcb-04bfc0420797 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:15.696051 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00bb2989-204d-40e5-afcb-04bfc0420797 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:15.825939 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-00bb2989-204d-40e5-afcb-04bfc0420797 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:15.833729 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-00bb2989-204d-40e5-afcb-04bfc0420797 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1365 microversion: 2.1 time: 0.149975 Jul 18 16:57:15.834289 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 355/729] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:15 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:16.848593 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:16.849847 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=6 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:16.853917 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-90c24657-8a93-4469-b226-b091c3577f17 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:16.857066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-90c24657-8a93-4469-b226-b091c3577f17 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:16.861430 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-90c24657-8a93-4469-b226-b091c3577f17 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:16.861814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-90c24657-8a93-4469-b226-b091c3577f17 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:16.862575 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-90c24657-8a93-4469-b226-b091c3577f17 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:16.863009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-90c24657-8a93-4469-b226-b091c3577f17 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:16.997560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-90c24657-8a93-4469-b226-b091c3577f17 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:17.005706 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-90c24657-8a93-4469-b226-b091c3577f17 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1554 microversion: 2.1 time: 0.158485 Jul 18 16:57:17.006275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 375/730] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:16 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:17.021811 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-699b7b11-f42a-4fad-aca1-3a4d470b138f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:17.022413 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-699b7b11-f42a-4fad-aca1-3a4d470b138f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:17.024242 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=6 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:17.029522 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-699b7b11-f42a-4fad-aca1-3a4d470b138f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.029970 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-699b7b11-f42a-4fad-aca1-3a4d470b138f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.030728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-699b7b11-f42a-4fad-aca1-3a4d470b138f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.031164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-699b7b11-f42a-4fad-aca1-3a4d470b138f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.116751 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-699b7b11-f42a-4fad-aca1-3a4d470b138f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098723 Jul 18 16:57:17.117384 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 356/731] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 16:57:17 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:17.492145 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3bfc0bd0-0d23-49da-936e-81378dff083f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:17.492808 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3bfc0bd0-0d23-49da-936e-81378dff083f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:17.499210 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3bfc0bd0-0d23-49da-936e-81378dff083f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.499747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3bfc0bd0-0d23-49da-936e-81378dff083f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.500531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3bfc0bd0-0d23-49da-936e-81378dff083f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.501533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3bfc0bd0-0d23-49da-936e-81378dff083f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.528130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3bfc0bd0-0d23-49da-936e-81378dff083f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:57:17.806707 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3bfc0bd0-0d23-49da-936e-81378dff083f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 204 len: 0 microversion: 2.1 time: 0.318156 Jul 18 16:57:17.807433 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 376/732] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:57:17 2022] DELETE /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:57:17.815740 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7f6c2d93-684a-4424-9ea2-54d84a8e66b0 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:17.816346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7f6c2d93-684a-4424-9ea2-54d84a8e66b0 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:17.822491 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7f6c2d93-684a-4424-9ea2-54d84a8e66b0 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.822947 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7f6c2d93-684a-4424-9ea2-54d84a8e66b0 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.823722 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7f6c2d93-684a-4424-9ea2-54d84a8e66b0 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.824446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7f6c2d93-684a-4424-9ea2-54d84a8e66b0 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.983907 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7f6c2d93-684a-4424-9ea2-54d84a8e66b0 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:17.991632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7f6c2d93-684a-4424-9ea2-54d84a8e66b0 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1576 microversion: 2.1 time: 0.179749 Jul 18 16:57:17.992210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 357/733] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:17 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:18.434921 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-06dc999d-699e-479a-a83a-b4ef9752afb3 req-8d3fcb0b-5acc-4817-9b7b-e3c32ce436f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2733168d-74ec-4dac-a804-6a9f03c2d409", "tag": "2ef11d7b-f237-4db2-a52b-57493a3fb7c8"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:18.443870 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-06dc999d-699e-479a-a83a-b4ef9752afb3 req-8d3fcb0b-5acc-4817-9b7b-e3c32ce436f0 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:18.444323 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-06dc999d-699e-479a-a83a-b4ef9752afb3 req-8d3fcb0b-5acc-4817-9b7b-e3c32ce436f0 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:18.456315 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-06dc999d-699e-479a-a83a-b4ef9752afb3 req-8d3fcb0b-5acc-4817-9b7b-e3c32ce436f0 service nova] Creating event network-changed:2ef11d7b-f237-4db2-a52b-57493a3fb7c8 for instance 2733168d-74ec-4dac-a804-6a9f03c2d409 on hv-cinder-84617 Jul 18 16:57:18.461144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-06dc999d-699e-479a-a83a-b4ef9752afb3 req-8d3fcb0b-5acc-4817-9b7b-e3c32ce436f0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030192 Jul 18 16:57:18.461944 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 377/734] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:19.011186 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0be5249d-528e-4cf8-984a-1638ae845047 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:19.011809 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0be5249d-528e-4cf8-984a-1638ae845047 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:19.019261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0be5249d-528e-4cf8-984a-1638ae845047 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:19.019709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0be5249d-528e-4cf8-984a-1638ae845047 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:19.020497 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0be5249d-528e-4cf8-984a-1638ae845047 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:19.020948 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0be5249d-528e-4cf8-984a-1638ae845047 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:19.193080 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0be5249d-528e-4cf8-984a-1638ae845047 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:19.201258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0be5249d-528e-4cf8-984a-1638ae845047 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1576 microversion: 2.1 time: 0.194130 Jul 18 16:57:19.201845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 358/735] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:19 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:20.220572 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f1891c6e-b593-439b-8735-f2b9b9164b42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:20.222007 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f1891c6e-b593-439b-8735-f2b9b9164b42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:20.228632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f1891c6e-b593-439b-8735-f2b9b9164b42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.229134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f1891c6e-b593-439b-8735-f2b9b9164b42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.229889 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f1891c6e-b593-439b-8735-f2b9b9164b42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.230323 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f1891c6e-b593-439b-8735-f2b9b9164b42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.372806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f1891c6e-b593-439b-8735-f2b9b9164b42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:20.380545 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f1891c6e-b593-439b-8735-f2b9b9164b42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1576 microversion: 2.1 time: 0.164831 Jul 18 16:57:20.381257 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 378/736] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:20 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:20.712527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-20c4e119-497e-443e-b201-4275666aaa58 req-0621c072-a68f-4c2b-b00f-5880bd6daaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69c45d3-ad0f-4135-9752-32f5baf001b2", "name": "network-vif-deleted", "tag": "23638164-6355-4304-87f3-85c18f5e1916"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:20.721228 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-20c4e119-497e-443e-b201-4275666aaa58 req-0621c072-a68f-4c2b-b00f-5880bd6daaa0 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.721783 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-20c4e119-497e-443e-b201-4275666aaa58 req-0621c072-a68f-4c2b-b00f-5880bd6daaa0 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.734317 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-20c4e119-497e-443e-b201-4275666aaa58 req-0621c072-a68f-4c2b-b00f-5880bd6daaa0 service nova] Creating event network-vif-deleted:23638164-6355-4304-87f3-85c18f5e1916 for instance f69c45d3-ad0f-4135-9752-32f5baf001b2 on hv-cinder-84617 Jul 18 16:57:20.740324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-20c4e119-497e-443e-b201-4275666aaa58 req-0621c072-a68f-4c2b-b00f-5880bd6daaa0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031277 Jul 18 16:57:20.741427 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 359/737] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:21.153263 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-85dd9848-5c34-444f-a474-48ba6e1e355e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:21.153877 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-85dd9848-5c34-444f-a474-48ba6e1e355e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:21.161191 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85dd9848-5c34-444f-a474-48ba6e1e355e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.161566 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85dd9848-5c34-444f-a474-48ba6e1e355e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.162345 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85dd9848-5c34-444f-a474-48ba6e1e355e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.162869 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85dd9848-5c34-444f-a474-48ba6e1e355e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.188120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-85dd9848-5c34-444f-a474-48ba6e1e355e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/ips" status: 200 len: 151 microversion: 2.20 time: 0.039539 Jul 18 16:57:21.195306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 379/738] 10.222.0.88 () {60 vars in 1288 bytes} [Mon Jul 18 16:57:21 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:57:21.399570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:21.400340 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:21.407317 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.407849 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.409313 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.409959 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.446427 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.446875 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.447317 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lazy-loading 'fault' on Instance uuid f69c45d3-ad0f-4135-9752-32f5baf001b2 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:57:21.491724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:21.501414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d30340bd-c114-4c7b-8316-e2f7181e08ad tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 200 len: 1229 microversion: 2.1 time: 0.106188 Jul 18 16:57:21.502044 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 360/739] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:21 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:22.517777 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:22.518420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:22.525144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:22.525629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:22.526365 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:22.526878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:22.543339 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] HTTP exception thrown: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Request method failure captured: Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 HTTP/1.1 Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZAq5Av5FCTu5VQPKY-YGaYzZ-DOp7zKd1cyuNw78Zypqy13Um9sWk-WqVBXPcH7Ac7znuC8MxTwaW7GcrjqtaOOcGBwRqmOPcWzK4fhku8uBtGIDRBicV4ofD8MJ8jsB1TtV2kY4AheQeademACMNHE2uhnDE6CNkWZ2W4vQwltlFs Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:57:22.545013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d68154d9fdb40f0848b676c1fed6a50", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}] Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-TestVolumeBootPattern-1667440206 Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-TestVolumeBootPattern-1667440206-project Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: cd69c5111dac492a9177128317f0962a Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-TestVolumeBootPattern-1667440206-project Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 16:57:22.546623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': 'f69c45d3-ad0f-4135-9752-32f5baf001b2'} Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:57:22.547548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 16:57:22.550195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:57:22.551738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Returning 404 to user: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:57:22.551738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c8ea896e-2a0e-435b-a49a-5c0b3eae180c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 404 len: 111 microversion: 2.1 time: 0.032601 Jul 18 16:57:22.551738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 380/740] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:22 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:57:22.644652 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-240985317", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-328566045", "security_groups": [{"name": "tempest-secgroup-smoke-122793974"}], "block_device_mapping_v2": [{"uuid": "42e8e64f-b7f2-4446-8fba-cd5e1886f88b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925915ce-ec30-4da0-b91d-e4af79017b65"}]}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:22.763019 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] validate_networks() for [('925915ce-ec30-4da0-b91d-e4af79017b65', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:57:23.143138 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:57:23.143561 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:57:23.144059 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:57:23.144467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:57:23.144896 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:57:23.154243 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.154785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.155498 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.155938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.173039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Getting quotas for project 5d68154d9fdb40f0848b676c1fed6a50. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:57:23.176996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Getting quotas for user cd69c5111dac492a9177128317f0962a and project 5d68154d9fdb40f0848b676c1fed6a50. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:57:23.234835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:57:23.237522 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42e8e64f-b7f2-4446-8fba-cd5e1886f88b',volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:57:23.349738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d86ff6db-f355-43ab-88c2-0c06fcac953e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:23.350199 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d86ff6db-f355-43ab-88c2-0c06fcac953e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:23.356440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d86ff6db-f355-43ab-88c2-0c06fcac953e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.356815 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d86ff6db-f355-43ab-88c2-0c06fcac953e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.360214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d86ff6db-f355-43ab-88c2-0c06fcac953e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.360214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d86ff6db-f355-43ab-88c2-0c06fcac953e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.389081 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-d86ff6db-f355-43ab-88c2-0c06fcac953e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lazy-loading 'flavor' on Instance uuid 48753a71-ab88-464c-91fd-21fd8f63c17f {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:57:23.557641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0a548430-55cf-4325-a57f-96f1bd6f873c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.916627 Jul 18 16:57:23.558500 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 361/741] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:57:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:57:23.568269 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6bde0668-4455-4fff-a7e5-78f1ff631554 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:23.568870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6bde0668-4455-4fff-a7e5-78f1ff631554 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:23.623865 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6bde0668-4455-4fff-a7e5-78f1ff631554 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:23.632353 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6bde0668-4455-4fff-a7e5-78f1ff631554 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1093 microversion: 2.1 time: 0.067852 Jul 18 16:57:23.633090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 362/742] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:23 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:23.915592 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d86ff6db-f355-43ab-88c2-0c06fcac953e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/action" status: 202 len: 0 microversion: 2.20 time: 0.569697 Jul 18 16:57:23.916504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 381/743] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 16:57:23 2022] POST /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:57:23.925017 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:23.926425 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:23.935568 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.936082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.936946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.937453 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:24.078433 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:24.087271 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:24.088762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:24.089946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4b3a775c-0478-41c4-85e6-a07c18fe2d0d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.169446 Jul 18 16:57:24.090504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 363/744] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:23 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:57:24.650422 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5137e031-4c8a-4bce-8a03-e268ab904807 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:24.651120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5137e031-4c8a-4bce-8a03-e268ab904807 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:24.657609 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5137e031-4c8a-4bce-8a03-e268ab904807 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:24.658090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5137e031-4c8a-4bce-8a03-e268ab904807 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:24.658870 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5137e031-4c8a-4bce-8a03-e268ab904807 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:24.659312 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5137e031-4c8a-4bce-8a03-e268ab904807 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:24.721440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5137e031-4c8a-4bce-8a03-e268ab904807 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:24.728871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5137e031-4c8a-4bce-8a03-e268ab904807 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1135 microversion: 2.1 time: 0.083101 Jul 18 16:57:24.729504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 382/745] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:24 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1135 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:25.108193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:25.108915 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:25.115535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.115977 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.116744 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.117240 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.255325 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:25.263485 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:25.265009 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:25.266157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4435a1b7-aa35-4d94-9f51-d44784722044 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.161924 Jul 18 16:57:25.266723 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 364/746] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:25 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:25.751881 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c3e0509a-cda2-4dfc-a067-41380ca43b95 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:25.752512 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c3e0509a-cda2-4dfc-a067-41380ca43b95 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:25.758982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c3e0509a-cda2-4dfc-a067-41380ca43b95 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.759430 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c3e0509a-cda2-4dfc-a067-41380ca43b95 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.760214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c3e0509a-cda2-4dfc-a067-41380ca43b95 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.760650 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c3e0509a-cda2-4dfc-a067-41380ca43b95 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.823926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c3e0509a-cda2-4dfc-a067-41380ca43b95 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:25.831952 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c3e0509a-cda2-4dfc-a067-41380ca43b95 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1209 microversion: 2.1 time: 0.083912 Jul 18 16:57:25.834007 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 383/747] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:25 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:26.286045 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:26.286642 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:26.293724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.298127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.298127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.298127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.784465 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:26.792740 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:26.794251 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:26.795398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3f6450ef-9945-4129-b408-afcf7c004002 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.514618 Jul 18 16:57:26.806270 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 365/748] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:26 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:26.848485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5b5f9211-4e45-48ad-8a08-251656019794 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:26.849156 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5b5f9211-4e45-48ad-8a08-251656019794 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:26.855689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b5f9211-4e45-48ad-8a08-251656019794 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.859432 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b5f9211-4e45-48ad-8a08-251656019794 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.859432 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b5f9211-4e45-48ad-8a08-251656019794 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.859432 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b5f9211-4e45-48ad-8a08-251656019794 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.005347 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5b5f9211-4e45-48ad-8a08-251656019794 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:27.009134 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:27.013988 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5b5f9211-4e45-48ad-8a08-251656019794 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1276 microversion: 2.1 time: 0.169325 Jul 18 16:57:27.014571 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 384/749] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:26 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:27.585949 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-411944ac-8328-4757-aa87-dea867540b70 req-a1edde16-ed74-4a0d-ac53-a6475b85e608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e96cdd8-f199-4396-ae3b-4d4abbb43ba3", "tag": "398167d3-62f4-4f3b-bbd8-8c2be263a68e"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:27.602519 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-411944ac-8328-4757-aa87-dea867540b70 req-a1edde16-ed74-4a0d-ac53-a6475b85e608 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.602519 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-411944ac-8328-4757-aa87-dea867540b70 req-a1edde16-ed74-4a0d-ac53-a6475b85e608 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.609558 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-411944ac-8328-4757-aa87-dea867540b70 req-a1edde16-ed74-4a0d-ac53-a6475b85e608 service nova] Creating event network-changed:398167d3-62f4-4f3b-bbd8-8c2be263a68e for instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 on hv-cinder-84617 Jul 18 16:57:27.615261 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-411944ac-8328-4757-aa87-dea867540b70 req-a1edde16-ed74-4a0d-ac53-a6475b85e608 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036224 Jul 18 16:57:27.615976 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 366/750] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:27.817100 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:27.817795 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:27.831505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.831505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.831505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.831505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.963449 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:27.971939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:27.973484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:27.974751 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5076b036-e630-4024-be6c-24c2d8e31679 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.163573 Jul 18 16:57:27.975313 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 385/751] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:27 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:28.031934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-334cf8b7-86f0-42ef-bacd-68379e4f7456 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:28.032643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-334cf8b7-86f0-42ef-bacd-68379e4f7456 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:28.038964 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-334cf8b7-86f0-42ef-bacd-68379e4f7456 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:28.039430 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-334cf8b7-86f0-42ef-bacd-68379e4f7456 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:28.042455 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-334cf8b7-86f0-42ef-bacd-68379e4f7456 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:28.042455 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-334cf8b7-86f0-42ef-bacd-68379e4f7456 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:28.249551 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-334cf8b7-86f0-42ef-bacd-68379e4f7456 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:28.258060 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-334cf8b7-86f0-42ef-bacd-68379e4f7456 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.230325 Jul 18 16:57:28.265436 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 367/752] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:28 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:28.993338 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:28.993936 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:29.000533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:29.001017 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:29.002425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:29.002866 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:29.135032 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:29.142919 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:29.144347 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:29.145532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f4d7de7c-5823-40db-acc8-4fc1738b1b46 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.156258 Jul 18 16:57:29.146094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 386/753] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:28 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:29.275166 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-63362f23-7b61-4c9f-8ca9-3269d99d9e88 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:29.275803 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-63362f23-7b61-4c9f-8ca9-3269d99d9e88 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:29.282336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-63362f23-7b61-4c9f-8ca9-3269d99d9e88 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:29.282880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-63362f23-7b61-4c9f-8ca9-3269d99d9e88 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:29.284090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-63362f23-7b61-4c9f-8ca9-3269d99d9e88 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:29.284527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-63362f23-7b61-4c9f-8ca9-3269d99d9e88 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:29.419821 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-63362f23-7b61-4c9f-8ca9-3269d99d9e88 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:29.427370 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-63362f23-7b61-4c9f-8ca9-3269d99d9e88 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.156015 Jul 18 16:57:29.427961 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 368/754] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:29 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:30.163953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:30.164568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:30.171059 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:30.171512 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:30.172276 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:30.172715 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:30.305387 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:30.313268 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:30.322881 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:30.322881 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f8a90b09-5795-4caa-8e1d-1bceed2df655 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.156485 Jul 18 16:57:30.322881 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 387/755] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:30 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:30.443776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e1755e82-d485-469b-80c6-09f49df8bcb7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:30.445034 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e1755e82-d485-469b-80c6-09f49df8bcb7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:30.451957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e1755e82-d485-469b-80c6-09f49df8bcb7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:30.452407 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e1755e82-d485-469b-80c6-09f49df8bcb7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:30.453218 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e1755e82-d485-469b-80c6-09f49df8bcb7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:30.453657 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e1755e82-d485-469b-80c6-09f49df8bcb7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:30.586919 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e1755e82-d485-469b-80c6-09f49df8bcb7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:30.594476 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e1755e82-d485-469b-80c6-09f49df8bcb7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.154739 Jul 18 16:57:30.595051 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 369/756] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:30 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:31.334868 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:31.335471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:31.341995 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:31.342448 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:31.343202 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:31.343633 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:31.481332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:31.489815 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:31.491227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:31.492401 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5d36ef7d-1027-4c4a-ae99-e2b526c24f8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.161415 Jul 18 16:57:31.492978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 388/757] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:31 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:31.611504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-03118ebd-24dd-43c3-b30e-feef194f4644 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:31.612089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-03118ebd-24dd-43c3-b30e-feef194f4644 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:31.618738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-03118ebd-24dd-43c3-b30e-feef194f4644 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:31.619186 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-03118ebd-24dd-43c3-b30e-feef194f4644 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:31.619958 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-03118ebd-24dd-43c3-b30e-feef194f4644 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:31.620397 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-03118ebd-24dd-43c3-b30e-feef194f4644 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:31.754360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-03118ebd-24dd-43c3-b30e-feef194f4644 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:31.761693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-03118ebd-24dd-43c3-b30e-feef194f4644 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.154150 Jul 18 16:57:31.762250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 370/758] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:31 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:32.510836 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:32.511447 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:32.517998 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:32.518480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:32.519306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:32.519737 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:32.652937 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:32.661639 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:32.663087 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:32.664246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7b2e8882-cb49-4dcc-acea-d0a8a0b6082c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.157475 Jul 18 16:57:32.664798 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 389/759] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:32 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:32.778825 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-69f5d217-11f8-4490-8488-ebdb19d97324 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:32.779412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-69f5d217-11f8-4490-8488-ebdb19d97324 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:32.786662 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-69f5d217-11f8-4490-8488-ebdb19d97324 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:32.787169 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-69f5d217-11f8-4490-8488-ebdb19d97324 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:32.787867 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-69f5d217-11f8-4490-8488-ebdb19d97324 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:32.788301 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-69f5d217-11f8-4490-8488-ebdb19d97324 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:32.792493 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=100 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:32.922473 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-69f5d217-11f8-4490-8488-ebdb19d97324 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:32.930712 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-69f5d217-11f8-4490-8488-ebdb19d97324 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.155693 Jul 18 16:57:32.931292 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 371/760] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:32 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:33.682922 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:33.683534 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:33.690221 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:33.690675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:33.691452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:33.691893 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:33.820825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:33.829071 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:33.831210 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:33.832358 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d6de372d-97b2-4973-a5ec-675f115b0674 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.153302 Jul 18 16:57:33.833712 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 390/761] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:33 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:33.947629 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ee89c10d-898e-4ecc-bca8-f852e04103c1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:33.948672 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ee89c10d-898e-4ecc-bca8-f852e04103c1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:33.950530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:33.951256 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=8 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:33.952389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:33.957179 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ee89c10d-898e-4ecc-bca8-f852e04103c1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:33.961348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ee89c10d-898e-4ecc-bca8-f852e04103c1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:33.961348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ee89c10d-898e-4ecc-bca8-f852e04103c1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:33.961348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ee89c10d-898e-4ecc-bca8-f852e04103c1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:34.090061 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ee89c10d-898e-4ecc-bca8-f852e04103c1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:34.100685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ee89c10d-898e-4ecc-bca8-f852e04103c1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.153759 Jul 18 16:57:34.100685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 372/762] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:33 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:34.850863 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:34.851477 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:34.858128 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:34.858577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:34.859345 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:34.860262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:34.991922 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:34.999915 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:35.002005 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:35.003167 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-69fad8e2-3ee2-4420-99b5-ca16645a88c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.156395 Jul 18 16:57:35.003735 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 391/763] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:34 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:35.114900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fc0ce7c8-9114-4e1a-80b4-57757a03d4b3 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:35.115452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fc0ce7c8-9114-4e1a-80b4-57757a03d4b3 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:35.122884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fc0ce7c8-9114-4e1a-80b4-57757a03d4b3 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:35.123376 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fc0ce7c8-9114-4e1a-80b4-57757a03d4b3 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:35.124143 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fc0ce7c8-9114-4e1a-80b4-57757a03d4b3 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:35.124570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fc0ce7c8-9114-4e1a-80b4-57757a03d4b3 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:35.263175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-fc0ce7c8-9114-4e1a-80b4-57757a03d4b3 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:35.271998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fc0ce7c8-9114-4e1a-80b4-57757a03d4b3 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.161461 Jul 18 16:57:35.273029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 373/764] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:35 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:36.020965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:36.021594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:36.023944 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:36.028690 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:36.029192 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:36.029973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:36.030418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:36.162066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:36.170232 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:36.171719 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:36.172925 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-200e3db8-af19-4584-8894-566acfec2113 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.155882 Jul 18 16:57:36.174143 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 392/765] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:36 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:57:36.289176 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6e2ec293-f037-49b6-9b95-ff00b22ee8f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:36.289795 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6e2ec293-f037-49b6-9b95-ff00b22ee8f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:36.296235 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6e2ec293-f037-49b6-9b95-ff00b22ee8f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:36.296686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6e2ec293-f037-49b6-9b95-ff00b22ee8f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:36.297478 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6e2ec293-f037-49b6-9b95-ff00b22ee8f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:36.297922 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6e2ec293-f037-49b6-9b95-ff00b22ee8f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:36.430003 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6e2ec293-f037-49b6-9b95-ff00b22ee8f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:36.437474 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6e2ec293-f037-49b6-9b95-ff00b22ee8f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.152209 Jul 18 16:57:36.440480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 374/766] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:36 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:36.803175 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-c834204e-85e3-4404-b8a8-fa56e94b1823 req-3618b5c0-aa04-4d1c-ad0c-0a89ae51bb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e96cdd8-f199-4396-ae3b-4d4abbb43ba3", "name": "network-vif-plugged", "status": "completed", "tag": "398167d3-62f4-4f3b-bbd8-8c2be263a68e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:36.813220 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-c834204e-85e3-4404-b8a8-fa56e94b1823 req-3618b5c0-aa04-4d1c-ad0c-0a89ae51bb45 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:36.813220 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-c834204e-85e3-4404-b8a8-fa56e94b1823 req-3618b5c0-aa04-4d1c-ad0c-0a89ae51bb45 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:36.825737 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-c834204e-85e3-4404-b8a8-fa56e94b1823 req-3618b5c0-aa04-4d1c-ad0c-0a89ae51bb45 service nova] Creating event network-vif-plugged:398167d3-62f4-4f3b-bbd8-8c2be263a68e for instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 on hv-cinder-84617 Jul 18 16:57:36.831255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-c834204e-85e3-4404-b8a8-fa56e94b1823 req-3618b5c0-aa04-4d1c-ad0c-0a89ae51bb45 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031756 Jul 18 16:57:36.836026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 393/767] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:37.192480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:37.193158 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:37.199641 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:37.200721 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:37.201011 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:37.201437 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:37.393041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:37.401213 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:37.402827 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:37.403996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d372657e-0f23-4bd7-b69f-b7beed321067 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.216262 Jul 18 16:57:37.404565 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 375/768] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:37 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:37.457146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2b91d061-f674-4aeb-bf52-9b496572dd70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:37.457806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2b91d061-f674-4aeb-bf52-9b496572dd70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:37.464116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2b91d061-f674-4aeb-bf52-9b496572dd70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:37.464566 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2b91d061-f674-4aeb-bf52-9b496572dd70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:37.465367 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2b91d061-f674-4aeb-bf52-9b496572dd70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:37.465805 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2b91d061-f674-4aeb-bf52-9b496572dd70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:37.611343 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2b91d061-f674-4aeb-bf52-9b496572dd70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:37.619550 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2b91d061-f674-4aeb-bf52-9b496572dd70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.168377 Jul 18 16:57:37.620141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 394/769] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:37 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:38.421841 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:38.422428 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:38.429927 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:38.430374 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:38.431149 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:38.431584 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:38.565317 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:38.573523 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:38.575904 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:38.576284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-654b76cd-2aee-4fa7-af75-b13e699fd440 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.158217 Jul 18 16:57:38.576857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 376/770] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:38 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:38.637013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5f660581-0f3e-4954-aa71-1f3b71e53f6b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:38.637619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5f660581-0f3e-4954-aa71-1f3b71e53f6b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:38.644094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5f660581-0f3e-4954-aa71-1f3b71e53f6b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:38.644551 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5f660581-0f3e-4954-aa71-1f3b71e53f6b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:38.645362 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5f660581-0f3e-4954-aa71-1f3b71e53f6b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:38.645806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5f660581-0f3e-4954-aa71-1f3b71e53f6b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:38.780911 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5f660581-0f3e-4954-aa71-1f3b71e53f6b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:38.788920 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5f660581-0f3e-4954-aa71-1f3b71e53f6b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1264 microversion: 2.1 time: 0.155814 Jul 18 16:57:38.789518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 395/771] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:38 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:39.594757 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:39.595409 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:39.602082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:39.602534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:39.603302 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:39.603794 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:39.741692 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:39.749765 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:39.751287 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:39.752705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d5656a1c-4f9b-499e-88c8-c5bcda36bbd0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.161900 Jul 18 16:57:39.754031 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 377/772] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:39 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:39.806043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5b76470c-2b7e-4240-96ba-87e1a4469855 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:39.807332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5b76470c-2b7e-4240-96ba-87e1a4469855 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:39.814471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b76470c-2b7e-4240-96ba-87e1a4469855 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:39.817718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b76470c-2b7e-4240-96ba-87e1a4469855 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:39.817718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b76470c-2b7e-4240-96ba-87e1a4469855 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:39.817718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b76470c-2b7e-4240-96ba-87e1a4469855 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:39.958648 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5b76470c-2b7e-4240-96ba-87e1a4469855 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:39.966431 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5b76470c-2b7e-4240-96ba-87e1a4469855 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1451 microversion: 2.1 time: 0.164717 Jul 18 16:57:39.967017 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 396/773] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:39 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:39.983872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2f925414-c432-4f6f-a26c-468176516a42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:39.984649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2f925414-c432-4f6f-a26c-468176516a42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:39.991715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f925414-c432-4f6f-a26c-468176516a42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:39.992161 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f925414-c432-4f6f-a26c-468176516a42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:39.992965 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f925414-c432-4f6f-a26c-468176516a42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:39.993402 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2f925414-c432-4f6f-a26c-468176516a42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:40.131870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2f925414-c432-4f6f-a26c-468176516a42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:40.139492 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2f925414-c432-4f6f-a26c-468176516a42 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1451 microversion: 2.1 time: 0.159483 Jul 18 16:57:40.143938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 378/774] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:39 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:40.772219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:40.773133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:40.779334 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:40.779790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:40.780604 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:40.781084 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:41.163422 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:41.171467 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:41.173008 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:41.174172 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-378e9c58-ed79-473e-9b1e-7048049e91d3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1743 microversion: 2.20 time: 0.407033 Jul 18 16:57:41.175243 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 397/775] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:40 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1743 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:42.070971 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-b2967307-eff4-4b55-ba97-167f92a66689 req-2257726f-9606-4f04-b361-89f39f00ad72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e96cdd8-f199-4396-ae3b-4d4abbb43ba3", "tag": "398167d3-62f4-4f3b-bbd8-8c2be263a68e"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:42.079762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-b2967307-eff4-4b55-ba97-167f92a66689 req-2257726f-9606-4f04-b361-89f39f00ad72 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:42.080300 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-b2967307-eff4-4b55-ba97-167f92a66689 req-2257726f-9606-4f04-b361-89f39f00ad72 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:42.092194 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-b2967307-eff4-4b55-ba97-167f92a66689 req-2257726f-9606-4f04-b361-89f39f00ad72 service nova] Creating event network-changed:398167d3-62f4-4f3b-bbd8-8c2be263a68e for instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 on hv-cinder-84617 Jul 18 16:57:42.097327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-b2967307-eff4-4b55-ba97-167f92a66689 req-2257726f-9606-4f04-b361-89f39f00ad72 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029975 Jul 18 16:57:42.098022 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 379/776] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:42.197868 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:42.199543 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:42.210805 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:42.211416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:42.212631 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:42.213176 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:42.358373 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:42.363548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:42.366517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:42.368125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-97eedfe2-98ae-4d7e-a9be-378c59c4aa54 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1743 microversion: 2.20 time: 0.174014 Jul 18 16:57:42.369359 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 398/777] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:42 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:42.781531 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-192dcef8-c5d0-49a8-8b2e-2ce30357cb78 req-454d0471-a15b-4d6b-aa82-c77ae062da88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48753a71-ab88-464c-91fd-21fd8f63c17f", "name": "network-vif-plugged", "status": "completed", "tag": "b47c20c9-b813-4d4c-a62a-1fe35f9924ca"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:42.798193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-192dcef8-c5d0-49a8-8b2e-2ce30357cb78 req-454d0471-a15b-4d6b-aa82-c77ae062da88 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:42.798879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-192dcef8-c5d0-49a8-8b2e-2ce30357cb78 req-454d0471-a15b-4d6b-aa82-c77ae062da88 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:42.820038 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-192dcef8-c5d0-49a8-8b2e-2ce30357cb78 req-454d0471-a15b-4d6b-aa82-c77ae062da88 service nova] Creating event network-vif-plugged:b47c20c9-b813-4d4c-a62a-1fe35f9924ca for instance 48753a71-ab88-464c-91fd-21fd8f63c17f on hv-cinder-84617 Jul 18 16:57:42.824118 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-192dcef8-c5d0-49a8-8b2e-2ce30357cb78 req-454d0471-a15b-4d6b-aa82-c77ae062da88 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049971 Jul 18 16:57:42.824582 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 380/778] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:43.386410 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:43.387045 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:43.396754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:43.397387 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:43.398383 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:43.398829 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:43.548858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:43.561416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:43.563547 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:43.565607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-643c1e5f-9ac9-4438-acee-77265fe20035 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.182398 Jul 18 16:57:43.566543 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 399/779] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:43 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:44.585429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:44.586125 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:44.596817 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:44.597796 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:44.598877 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:44.603684 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:44.777026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:44.787205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:44.788692 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:44.790058 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6626c092-58db-466e-86bc-f447931efb70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.209601 Jul 18 16:57:44.800145 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 381/780] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:44 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:45.808788 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:45.809515 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:45.816594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:45.817093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:45.817897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:45.818345 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:45.965777 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:45.974345 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:45.976132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:45.977348 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0499e035-1e65-4f18-a102-45451d7ffcf0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.172829 Jul 18 16:57:45.977988 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 400/781] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:45 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:46.995738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:46.996976 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:47.004904 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:47.005452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:47.006299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:47.006950 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:47.161520 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:47.170160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:47.171922 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:47.173162 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cc1842cd-8f21-4ac8-b6df-5462bce1495e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.181576 Jul 18 16:57:47.173684 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 382/782] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:46 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:48.192395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:48.193731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:48.203163 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:48.203611 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:48.204389 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:48.204822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:48.360749 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:48.369454 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:48.372578 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:48.372578 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-84957be8-fad5-4d09-87fc-baade7635c70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.184345 Jul 18 16:57:48.372827 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 401/783] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:48 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:49.393244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:49.394307 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:49.405865 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:49.406554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:49.407623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:49.408188 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:49.541784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:49.550241 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:49.551760 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:49.552937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6c853eed-6e64-44f7-8fe0-dd955d551424 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.165660 Jul 18 16:57:49.553525 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 383/784] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:49 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:50.571888 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:50.572674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:50.582351 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:50.582816 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:50.583603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:50.584040 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:50.588912 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:50.739417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:50.748757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:50.750402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:50.751730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c46f022f-1419-4ef7-85ec-8777eb383e7d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.183892 Jul 18 16:57:50.757569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 402/785] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:50 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:51.776702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:51.777336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:51.784724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:51.785201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:51.785968 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:51.786397 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:51.938722 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:51.948015 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:51.949567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:51.950742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2d416027-4eea-4d71-9205-3196dc7cff4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.179648 Jul 18 16:57:51.961847 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 384/786] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:51 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:52.969314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:52.969923 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:52.979177 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:52.979355 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:52.980131 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:52.980576 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:53.143558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:53.154652 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:53.156185 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:53.161581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e07023ae-7b37-4a56-bdb4-1403b876eee5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.195957 Jul 18 16:57:53.172350 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 403/787] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:52 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:54.180207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:54.180759 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:54.187551 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:54.188001 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:54.188777 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:54.189276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:54.326156 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:54.334226 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:54.335737 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:54.336913 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-586f4449-3054-45e9-af4a-655741199b47 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1738 microversion: 2.20 time: 0.160735 Jul 18 16:57:54.337468 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 385/788] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:54 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:54.669284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-68229d9b-cc74-4f32-8058-7b4f369612f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:54.669844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-68229d9b-cc74-4f32-8058-7b4f369612f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:54.676318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68229d9b-cc74-4f32-8058-7b4f369612f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:54.676774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68229d9b-cc74-4f32-8058-7b4f369612f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:54.681108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68229d9b-cc74-4f32-8058-7b4f369612f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:54.681108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68229d9b-cc74-4f32-8058-7b4f369612f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:54.701472 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-68229d9b-cc74-4f32-8058-7b4f369612f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/ips" status: 200 len: 149 microversion: 2.1 time: 0.036070 Jul 18 16:57:54.702039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 404/789] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 16:57:54 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:55.356040 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:55.356643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:55.364275 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:55.364715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:55.365644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:55.366069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:55.611147 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:55.619764 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:55.621276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:55.625581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0919b0b4-5db2-4bde-b444-bb0219fcca8d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1720 microversion: 2.20 time: 0.271132 Jul 18 16:57:55.625581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 386/790] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:55 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1720 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:56.423659 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-570d3e82-c7c2-49bf-95aa-a8af56bce908 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "543e8d2b-ee1b-4ebb-a751-60786e571416"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:56.424755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-570d3e82-c7c2-49bf-95aa-a8af56bce908 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:56.431291 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-570d3e82-c7c2-49bf-95aa-a8af56bce908 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:56.431730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-570d3e82-c7c2-49bf-95aa-a8af56bce908 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:56.432490 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-570d3e82-c7c2-49bf-95aa-a8af56bce908 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:56.432942 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-570d3e82-c7c2-49bf-95aa-a8af56bce908 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:56.641047 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:56.641572 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:56.648015 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:56.648456 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:56.649237 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:56.649664 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:56.778105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:56.786040 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:56.787523 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:56.788656 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f91bd799-3e79-43cf-a7e9-22d501d3c80e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1720 microversion: 2.20 time: 0.151604 Jul 18 16:57:56.789359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 387/791] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:56 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:57:57.807372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:57.808041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:57.815410 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.815855 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.816618 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:57.817077 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:57.969413 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:57.977990 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:57.979495 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:57.982186 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-052ee119-dd65-4dd3-bec4-96fbbcda8be9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1723 microversion: 2.20 time: 0.177615 Jul 18 16:57:57.982186 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 388/792] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:57 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:57:57.999205 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-91fa1bc2-828c-434c-a8aa-a766a736ad3e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34004825-591f-434c-82c0-d7900f353f72"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:58.000334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-91fa1bc2-828c-434c-a8aa-a766a736ad3e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:58.006940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-91fa1bc2-828c-434c-a8aa-a766a736ad3e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:58.007390 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-91fa1bc2-828c-434c-a8aa-a766a736ad3e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:58.008187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-91fa1bc2-828c-434c-a8aa-a766a736ad3e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:58.008626 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-91fa1bc2-828c-434c-a8aa-a766a736ad3e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:58.012840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=100 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:58.135468 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-570d3e82-c7c2-49bf-95aa-a8af56bce908 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.715531 Jul 18 16:57:58.136097 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 405/793] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:57:56 2022] POST /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-volume_attachments => generated 194 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:58.756669 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-bb9ff054-0194-430c-b580-01039fbf73b9 req-62b7bedd-edbf-4539-b264-5baa4b911ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48753a71-ab88-464c-91fd-21fd8f63c17f", "name": "network-vif-unplugged", "status": "completed", "tag": "b47c20c9-b813-4d4c-a62a-1fe35f9924ca"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:58.767055 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-bb9ff054-0194-430c-b580-01039fbf73b9 req-62b7bedd-edbf-4539-b264-5baa4b911ed2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:58.767532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-bb9ff054-0194-430c-b580-01039fbf73b9 req-62b7bedd-edbf-4539-b264-5baa4b911ed2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:58.778630 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.compute.server_external_events [req-bb9ff054-0194-430c-b580-01039fbf73b9 req-62b7bedd-edbf-4539-b264-5baa4b911ed2 service nova] Unable to find a host for instance 48753a71-ab88-464c-91fd-21fd8f63c17f. Dropping event network-vif-unplugged {{(pid=124753) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 16:57:58.779532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-bb9ff054-0194-430c-b580-01039fbf73b9 req-62b7bedd-edbf-4539-b264-5baa4b911ed2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028288 Jul 18 16:57:58.783970 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 406/794] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 18 16:57:59.141258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-91fa1bc2-828c-434c-a8aa-a766a736ad3e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.145834 Jul 18 16:57:59.142536 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 389/795] 10.222.0.88 () {62 vars in 1363 bytes} [Mon Jul 18 16:57:57 2022] POST /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments => generated 188 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:57:59.301074 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4ea6422f-2b2e-4259-a0ba-ce29c43afd5d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:59.301900 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4ea6422f-2b2e-4259-a0ba-ce29c43afd5d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:59.309415 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4ea6422f-2b2e-4259-a0ba-ce29c43afd5d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:59.310445 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4ea6422f-2b2e-4259-a0ba-ce29c43afd5d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:59.311596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4ea6422f-2b2e-4259-a0ba-ce29c43afd5d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:59.312123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4ea6422f-2b2e-4259-a0ba-ce29c43afd5d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:59.597349 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4ea6422f-2b2e-4259-a0ba-ce29c43afd5d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/action" status: 202 len: 0 microversion: 2.20 time: 0.300666 Jul 18 16:57:59.597831 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 407/796] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 16:57:59 2022] POST /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:57:59.606105 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:59.606716 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:59.614367 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:59.614884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:59.615571 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:59.616011 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:59.747856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:59.756360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:59.757889 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:59.759027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3f55df18-d8d7-4f04-a52e-d837f98f510b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1749 microversion: 2.20 time: 0.156967 Jul 18 16:57:59.759590 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 390/797] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:57:59 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:00.777682 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:00.778260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:00.784238 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:00.784681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:00.785474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:00.785904 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:00.924938 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:00.934151 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:00.935688 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:00.936861 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ed83d7a5-a4a3-473c-bfb4-4cdfe78af73b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1749 microversion: 2.20 time: 0.163616 Jul 18 16:58:00.937705 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 408/798] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:00 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:01.956546 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:01.957171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:01.963358 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:01.963797 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:01.964553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:01.965009 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:02.160660 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:02.169378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:02.170858 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:02.171999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-47af01d4-6ab4-4893-8409-c6dabc6d7d43 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1751 microversion: 2.20 time: 0.219860 Jul 18 16:58:02.172857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 391/799] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:01 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1751 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:03.190503 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:03.191060 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:03.198002 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:03.198443 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:03.199201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:03.199631 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:03.330005 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:03.338548 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:03.340030 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:03.341203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-45af4573-ac33-4090-ae1d-70f6aba7e47b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1751 microversion: 2.20 time: 0.154658 Jul 18 16:58:03.341757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 409/800] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:03 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:04.359773 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:04.360384 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:04.367792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:04.371445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:04.371445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:04.371445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:04.509692 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:04.518666 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:04.520153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:04.521331 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3aeaa63a-7a16-468f-84ae-1dae6c29ef0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1751 microversion: 2.20 time: 0.165473 Jul 18 16:58:04.521886 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 392/801] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:04 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:05.546466 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:05.547087 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:05.553790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:05.554246 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:05.555026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:05.555465 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:05.688070 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:05.697069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:05.698825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:05.699975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5d2380d1-10f0-4b6c-857b-da63434d4149 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1751 microversion: 2.20 time: 0.157509 Jul 18 16:58:05.700540 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 410/802] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:05 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:06.698406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-675cf72f-f5e3-42b3-ab48-e28e6546aa8f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: .version_select at 0x7fd4f502e940>, body: {"keypair": {"name": "tempest-keypair-292571061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEO4AkC5E5AJKeWsEiJ2fGzASbK2+bj+7WxyBTVDnk1APQY2LWTcqd8qWimhVBkGXrYYjcSyobuNS6H6BBHoylwqt4chh13xgKP7+jYYBHNm9HvFwGp5FBbIXXRT9qNOg=="}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:06.703093 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=42 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:06.715463 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-675cf72f-f5e3-42b3-ab48-e28e6546aa8f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for project 25de8ee0667645a3864d846675d460e1. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:58:06.719466 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-675cf72f-f5e3-42b3-ab48-e28e6546aa8f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for user 730d6426b4ee4cf38893fe2e60b97230 and project 25de8ee0667645a3864d846675d460e1. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:58:06.719642 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:06.720220 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:06.727067 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:06.727523 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:06.728546 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:06.728952 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:06.827026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-675cf72f-f5e3-42b3-ab48-e28e6546aa8f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127140 Jul 18 16:58:06.827026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 393/803] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:58:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:06.869052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:06.878064 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:06.879568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:06.880728 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0b0e5a7e-d337-4ef3-96dc-31a4299e5207 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1751 microversion: 2.20 time: 0.165908 Jul 18 16:58:06.881314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 411/804] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:06 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:07.900618 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:07.901264 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:07.907455 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:07.908534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:07.909327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:07.909758 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:08.163670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:08.172255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:08.174066 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:08.175268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-96881684-418c-4ca0-bb3d-3aab31856c74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.279921 Jul 18 16:58:08.185820 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 394/805] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:07 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:09.193553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:09.194392 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:09.197434 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=42 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:09.202855 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.203586 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.204765 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:09.205468 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:09.411051 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:09.424571 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:09.427352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:09.429228 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-222b4244-6c67-4eac-be01-affb3ae86568 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.239375 Jul 18 16:58:09.440197 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 412/806] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:09 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:09.498386 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2096295818", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9ef866c-b807-4e8d-a4b6-a34e3d904b55"}], "security_groups": [{"name": "tempest-securitygroup--2118423702"}], "key_name": "tempest-keypair-292571061", "user_data": "}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:09.638075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] validate_networks() for [('a9ef866c-b807-4e8d-a4b6-a34e3d904b55', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:58:10.087706 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:58:10.088132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:58:10.088599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:58:10.089151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:58:10.089569 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:58:10.099924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:10.101107 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:10.103203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:10.104176 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:10.126115 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for project 25de8ee0667645a3864d846675d460e1. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:58:10.131135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for user 730d6426b4ee4cf38893fe2e60b97230 and project 25de8ee0667645a3864d846675d460e1. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:58:10.148991 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:58:10.151554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:58:10.305911 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-465fb665-caf8-4668-985e-93b6bf7bd49a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.812816 Jul 18 16:58:10.306870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 395/807] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:58:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:58:10.317447 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a3e96811-7bd0-44fb-8ea1-7cfb75f551da tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:10.318085 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a3e96811-7bd0-44fb-8ea1-7cfb75f551da tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:10.386090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a3e96811-7bd0-44fb-8ea1-7cfb75f551da tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:10.396851 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a3e96811-7bd0-44fb-8ea1-7cfb75f551da tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1241 microversion: 2.1 time: 0.082794 Jul 18 16:58:10.396851 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 413/808] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:10 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:10.447939 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:10.448552 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:10.460373 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:10.460894 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:10.461854 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:10.462433 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:10.617577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:10.627473 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:10.629006 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:10.630260 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d6da9f78-0659-4255-adf5-e6a56203dde0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.186534 Jul 18 16:58:10.630831 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 396/809] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:10 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:11.413277 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e0ebad70-50cb-45f0-949e-aa0c1c0110c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:11.413883 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e0ebad70-50cb-45f0-949e-aa0c1c0110c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:11.421108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e0ebad70-50cb-45f0-949e-aa0c1c0110c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.421489 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e0ebad70-50cb-45f0-949e-aa0c1c0110c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.422251 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e0ebad70-50cb-45f0-949e-aa0c1c0110c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.422682 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e0ebad70-50cb-45f0-949e-aa0c1c0110c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.486250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e0ebad70-50cb-45f0-949e-aa0c1c0110c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.493958 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e0ebad70-50cb-45f0-949e-aa0c1c0110c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.084769 Jul 18 16:58:11.494533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 414/810] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:11 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:11.647521 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:11.648159 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:11.654727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.655239 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.656018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:11.656466 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:11.805279 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.814643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.816146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:11.817324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-44a03ecc-ee90-498a-9640-7a1b7fa0918b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.173732 Jul 18 16:58:11.820983 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 397/811] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:11 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:12.514033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f9886898-cb6f-4054-aac6-eddda0134fa7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:12.515580 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f9886898-cb6f-4054-aac6-eddda0134fa7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:12.523105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f9886898-cb6f-4054-aac6-eddda0134fa7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:12.523560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f9886898-cb6f-4054-aac6-eddda0134fa7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:12.524341 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f9886898-cb6f-4054-aac6-eddda0134fa7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:12.524783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f9886898-cb6f-4054-aac6-eddda0134fa7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:12.592620 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f9886898-cb6f-4054-aac6-eddda0134fa7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:12.600755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f9886898-cb6f-4054-aac6-eddda0134fa7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.092343 Jul 18 16:58:12.601424 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 415/812] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:12 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:12.835508 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:12.836153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:12.843506 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:12.843944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:12.844803 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:12.845410 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:12.998244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.007372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.008986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.010152 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f29c4e06-99c8-449c-a17c-2c1c4d20db8f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.178710 Jul 18 16:58:13.010713 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 398/813] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:12 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:13.618050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8c9f9cd0-6d69-4453-a4e2-3329936ce6ed tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:13.618671 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8c9f9cd0-6d69-4453-a4e2-3329936ce6ed tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:13.634508 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8c9f9cd0-6d69-4453-a4e2-3329936ce6ed tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.635230 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8c9f9cd0-6d69-4453-a4e2-3329936ce6ed tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.636197 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8c9f9cd0-6d69-4453-a4e2-3329936ce6ed tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:13.636667 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8c9f9cd0-6d69-4453-a4e2-3329936ce6ed tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:13.715007 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8c9f9cd0-6d69-4453-a4e2-3329936ce6ed tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:13.722937 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8c9f9cd0-6d69-4453-a4e2-3329936ce6ed tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.108723 Jul 18 16:58:13.723714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 416/814] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:13 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:14.030230 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:14.032177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:14.043038 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.044010 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.045583 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.046486 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.181895 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.190133 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.191660 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.192801 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-94f435f2-d66a-4df3-ad7f-b9685175c4c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.167860 Jul 18 16:58:14.193400 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 399/815] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:14 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:14.741284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c204be43-42ea-4a43-8574-568876d77fd4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:14.742796 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c204be43-42ea-4a43-8574-568876d77fd4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:14.749893 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c204be43-42ea-4a43-8574-568876d77fd4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.750758 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c204be43-42ea-4a43-8574-568876d77fd4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.752532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c204be43-42ea-4a43-8574-568876d77fd4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:14.753152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c204be43-42ea-4a43-8574-568876d77fd4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:14.818740 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c204be43-42ea-4a43-8574-568876d77fd4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:14.826674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c204be43-42ea-4a43-8574-568876d77fd4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.090628 Jul 18 16:58:14.828103 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 417/816] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:14 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:15.211309 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:15.211908 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:15.218593 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.219046 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.219812 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.220899 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.357430 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.372052 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.374934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.377294 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-529d648b-a3ff-4e96-b92b-0f84885b0905 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.168877 Jul 18 16:58:15.389787 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 400/817] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:15 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:15.844928 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-71bcab76-1b28-4a2c-9ca8-981374e77389 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:15.846326 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-71bcab76-1b28-4a2c-9ca8-981374e77389 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:15.853343 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-71bcab76-1b28-4a2c-9ca8-981374e77389 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.853792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-71bcab76-1b28-4a2c-9ca8-981374e77389 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.854571 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-71bcab76-1b28-4a2c-9ca8-981374e77389 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:15.855009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-71bcab76-1b28-4a2c-9ca8-981374e77389 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:15.875196 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:15.919717 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-71bcab76-1b28-4a2c-9ca8-981374e77389 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:15.927822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-71bcab76-1b28-4a2c-9ca8-981374e77389 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.087465 Jul 18 16:58:15.928491 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 418/818] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:15 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:16.396693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:16.397317 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:16.403426 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.403865 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.404616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.405084 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.550153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:16.559186 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:16.560737 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:16.562193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ff5b2d36-4761-4451-81c8-81818cad5d42 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.169268 Jul 18 16:58:16.563203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 401/819] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:16 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:16.944815 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ff78b701-9750-4532-95b5-58e022a31e44 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:16.945442 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ff78b701-9750-4532-95b5-58e022a31e44 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:16.952860 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ff78b701-9750-4532-95b5-58e022a31e44 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.953369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ff78b701-9750-4532-95b5-58e022a31e44 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:16.954078 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ff78b701-9750-4532-95b5-58e022a31e44 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:16.955039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ff78b701-9750-4532-95b5-58e022a31e44 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.018510 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ff78b701-9750-4532-95b5-58e022a31e44 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.026100 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ff78b701-9750-4532-95b5-58e022a31e44 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.085160 Jul 18 16:58:17.026670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 419/820] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:16 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:17.583459 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:17.584153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:17.591244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:17.591699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.592484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:17.593055 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:17.731937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.740907 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.742418 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:17.743559 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7b5c9b15-d3e0-4291-8e75-736e34c5b725 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.165181 Jul 18 16:58:17.744129 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 402/821] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:17 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:18.043992 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e66dea97-6bf2-4b84-a89e-87fd223a3a36 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:18.044754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e66dea97-6bf2-4b84-a89e-87fd223a3a36 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:18.052269 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e66dea97-6bf2-4b84-a89e-87fd223a3a36 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.052722 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e66dea97-6bf2-4b84-a89e-87fd223a3a36 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.053531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e66dea97-6bf2-4b84-a89e-87fd223a3a36 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.053968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e66dea97-6bf2-4b84-a89e-87fd223a3a36 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.125112 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e66dea97-6bf2-4b84-a89e-87fd223a3a36 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:18.133535 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e66dea97-6bf2-4b84-a89e-87fd223a3a36 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.093450 Jul 18 16:58:18.134130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 420/822] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:18 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:18.763073 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:18.763894 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:18.771441 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.772007 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.772765 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:18.773168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:18.932260 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:18.941705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:18.944076 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:18.944434 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e18ec3f5-845e-4cfe-bfc2-0b89c7b7335f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.185967 Jul 18 16:58:18.945388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 403/823] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:18 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:19.151031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2c441372-e7d2-4b79-8caf-906c66a83db2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:19.151573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2c441372-e7d2-4b79-8caf-906c66a83db2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:19.159007 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2c441372-e7d2-4b79-8caf-906c66a83db2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.159462 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2c441372-e7d2-4b79-8caf-906c66a83db2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.160245 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2c441372-e7d2-4b79-8caf-906c66a83db2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.160686 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2c441372-e7d2-4b79-8caf-906c66a83db2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.224590 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2c441372-e7d2-4b79-8caf-906c66a83db2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:19.232418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2c441372-e7d2-4b79-8caf-906c66a83db2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.085730 Jul 18 16:58:19.233021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 421/824] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:19 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:19.965602 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:19.966393 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:19.975998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.976747 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:19.977836 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:19.978531 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.115479 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:20.128215 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.130211 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:20.135420 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.136975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.138126 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a75216be-ba21-46c8-b93e-3d1524ee4343 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.178069 Jul 18 16:58:20.138692 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 404/825] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:19 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:20.249916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-118f53a0-3b80-4c88-a9e4-0d477f75982f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:20.250490 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-118f53a0-3b80-4c88-a9e4-0d477f75982f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:20.257558 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-118f53a0-3b80-4c88-a9e4-0d477f75982f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.258007 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-118f53a0-3b80-4c88-a9e4-0d477f75982f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.258769 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-118f53a0-3b80-4c88-a9e4-0d477f75982f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:20.259206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-118f53a0-3b80-4c88-a9e4-0d477f75982f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:20.319053 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-118f53a0-3b80-4c88-a9e4-0d477f75982f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:20.326758 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-118f53a0-3b80-4c88-a9e4-0d477f75982f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.080791 Jul 18 16:58:20.327322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 422/826] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:20 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:21.157487 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:21.158097 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:21.160337 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=10 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:21.166422 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.167937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.167937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.168209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.301935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.310851 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.318011 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.318011 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-da0e63b6-a3f9-451f-9e21-6851eb12a918 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.160367 Jul 18 16:58:21.318011 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 405/827] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:21 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:21.343895 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-502adece-3c67-4321-a56e-f9bca435a4bf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:21.346702 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-502adece-3c67-4321-a56e-f9bca435a4bf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:21.346702 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:21.351929 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-502adece-3c67-4321-a56e-f9bca435a4bf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.352372 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-502adece-3c67-4321-a56e-f9bca435a4bf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.353185 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-502adece-3c67-4321-a56e-f9bca435a4bf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:21.353613 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-502adece-3c67-4321-a56e-f9bca435a4bf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:21.418625 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-502adece-3c67-4321-a56e-f9bca435a4bf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:21.427635 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-502adece-3c67-4321-a56e-f9bca435a4bf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1245 microversion: 2.1 time: 0.087589 Jul 18 16:58:21.428219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 423/828] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:21 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:22.333476 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:22.334181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:22.341661 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.342114 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.342915 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.343347 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.445114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b4223cc1-d003-4e4a-990e-98a5f661510b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:22.445757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b4223cc1-d003-4e4a-990e-98a5f661510b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:22.453627 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b4223cc1-d003-4e4a-990e-98a5f661510b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.459106 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b4223cc1-d003-4e4a-990e-98a5f661510b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.459106 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b4223cc1-d003-4e4a-990e-98a5f661510b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:22.459106 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b4223cc1-d003-4e4a-990e-98a5f661510b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:22.478012 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:22.486945 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:22.488556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:22.489887 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e260e838-5e0e-4816-aeb2-7112bcb51e4a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.160999 Jul 18 16:58:22.490525 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 406/829] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:22 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:22.524540 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b4223cc1-d003-4e4a-990e-98a5f661510b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:22.532196 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b4223cc1-d003-4e4a-990e-98a5f661510b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1293 microversion: 2.1 time: 0.091313 Jul 18 16:58:22.532906 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 424/830] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:22 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:23.507570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:23.508185 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:23.514845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.515329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.516083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.516653 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.553517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e51e428b-d182-4054-a90d-c175c50d1646 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:23.554107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e51e428b-d182-4054-a90d-c175c50d1646 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:23.561018 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e51e428b-d182-4054-a90d-c175c50d1646 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.575132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e51e428b-d182-4054-a90d-c175c50d1646 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.575132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e51e428b-d182-4054-a90d-c175c50d1646 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:23.575132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-e51e428b-d182-4054-a90d-c175c50d1646 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:23.627051 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e51e428b-d182-4054-a90d-c175c50d1646 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.634926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e51e428b-d182-4054-a90d-c175c50d1646 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1299 microversion: 2.1 time: 0.085982 Jul 18 16:58:23.635505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 425/831] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:23 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:58:23.731901 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.740625 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.742157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:23.743322 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8666d9ea-2090-43b8-a809-0c212ddb1e58 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.239670 Jul 18 16:58:23.744077 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 407/832] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:23 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:24.652792 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-690d28bd-a6da-4d50-85f2-636c437e74d8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:24.653435 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-690d28bd-a6da-4d50-85f2-636c437e74d8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:24.660551 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-690d28bd-a6da-4d50-85f2-636c437e74d8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.661042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-690d28bd-a6da-4d50-85f2-636c437e74d8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.661839 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-690d28bd-a6da-4d50-85f2-636c437e74d8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.662275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-690d28bd-a6da-4d50-85f2-636c437e74d8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.764146 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:24.765043 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:24.774532 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.775364 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.776548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:24.777924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:24.819556 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-690d28bd-a6da-4d50-85f2-636c437e74d8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.829410 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-690d28bd-a6da-4d50-85f2-636c437e74d8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1367 microversion: 2.1 time: 0.180334 Jul 18 16:58:24.829994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 426/833] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:24 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:24.956454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.965346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.966972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:24.968171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-909e258f-3375-40e2-86ba-246404f10a06 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.210042 Jul 18 16:58:24.968719 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 408/834] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:24 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:25.006517 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-ca0c561e-0f41-459f-bbc0-093b450ecba2 req-d0c6503e-3bca-4898-9d2f-26f177e591d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09f72cd-57c2-470c-b58b-60b79684a8d7", "tag": "b01a781d-dfe7-4791-b135-427c4cd7eeae"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:25.015823 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-ca0c561e-0f41-459f-bbc0-093b450ecba2 req-d0c6503e-3bca-4898-9d2f-26f177e591d2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.016368 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-ca0c561e-0f41-459f-bbc0-093b450ecba2 req-d0c6503e-3bca-4898-9d2f-26f177e591d2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.038725 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-ca0c561e-0f41-459f-bbc0-093b450ecba2 req-d0c6503e-3bca-4898-9d2f-26f177e591d2 service nova] Creating event network-changed:b01a781d-dfe7-4791-b135-427c4cd7eeae for instance c09f72cd-57c2-470c-b58b-60b79684a8d7 on hv-cinder-84617 Jul 18 16:58:25.044362 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-ca0c561e-0f41-459f-bbc0-093b450ecba2 req-d0c6503e-3bca-4898-9d2f-26f177e591d2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041551 Jul 18 16:58:25.045117 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 427/835] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:25.845852 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c6d72cec-d16d-4385-b514-1b4691e5c902 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:25.846552 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c6d72cec-d16d-4385-b514-1b4691e5c902 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:25.853080 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c6d72cec-d16d-4385-b514-1b4691e5c902 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.853540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c6d72cec-d16d-4385-b514-1b4691e5c902 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.854314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c6d72cec-d16d-4385-b514-1b4691e5c902 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:25.854760 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c6d72cec-d16d-4385-b514-1b4691e5c902 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:25.988110 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:25.988802 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:26.001167 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.001629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.003038 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:26.003475 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:26.069129 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c6d72cec-d16d-4385-b514-1b4691e5c902 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.078170 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c6d72cec-d16d-4385-b514-1b4691e5c902 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1367 microversion: 2.1 time: 0.236073 Jul 18 16:58:26.078761 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 409/836] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:25 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:26.161526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.171660 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.173209 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:26.174941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a4815da7-a299-4b35-84ad-443f00997943 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.191605 Jul 18 16:58:26.175512 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 428/837] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:25 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:27.101480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-efda89b8-a0f9-484a-a208-16eeace91a8e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.102081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-efda89b8-a0f9-484a-a208-16eeace91a8e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.108548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-efda89b8-a0f9-484a-a208-16eeace91a8e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.109023 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-efda89b8-a0f9-484a-a208-16eeace91a8e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.109814 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-efda89b8-a0f9-484a-a208-16eeace91a8e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.110246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-efda89b8-a0f9-484a-a208-16eeace91a8e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.193010 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:27.193702 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:27.200587 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.201080 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.201867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:27.202312 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:27.243996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-efda89b8-a0f9-484a-a208-16eeace91a8e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.251759 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-efda89b8-a0f9-484a-a208-16eeace91a8e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1367 microversion: 2.1 time: 0.154188 Jul 18 16:58:27.252870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 410/838] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:27.333079 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.341610 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.343135 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:27.344276 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-44653e91-42f6-45f7-a662-9dbd0a8abcc9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.155953 Jul 18 16:58:27.344829 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 429/839] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:27 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:28.269560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-cd9bc7b9-4506-4a7f-802d-0c26bb8971ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:28.270147 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-cd9bc7b9-4506-4a7f-802d-0c26bb8971ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:28.276687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cd9bc7b9-4506-4a7f-802d-0c26bb8971ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.277155 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cd9bc7b9-4506-4a7f-802d-0c26bb8971ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.277919 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cd9bc7b9-4506-4a7f-802d-0c26bb8971ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.278343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-cd9bc7b9-4506-4a7f-802d-0c26bb8971ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.362707 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:28.363321 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:28.369893 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.370349 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.371126 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:28.371568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:28.411334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-cd9bc7b9-4506-4a7f-802d-0c26bb8971ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:28.418779 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-cd9bc7b9-4506-4a7f-802d-0c26bb8971ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1367 microversion: 2.1 time: 0.153148 Jul 18 16:58:28.419367 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 411/840] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:28 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:28.504562 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:28.512914 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:28.514425 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:28.515581 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1ae75c96-512d-4fa7-871d-e6abf6efe0ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.157320 Jul 18 16:58:28.516136 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 430/841] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:28 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:29.435532 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-73a9ab2c-9054-4573-bf33-7f091c99afc6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.436409 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-73a9ab2c-9054-4573-bf33-7f091c99afc6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.442678 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-73a9ab2c-9054-4573-bf33-7f091c99afc6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.443060 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-73a9ab2c-9054-4573-bf33-7f091c99afc6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.443833 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-73a9ab2c-9054-4573-bf33-7f091c99afc6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.444264 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-73a9ab2c-9054-4573-bf33-7f091c99afc6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.534193 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.534899 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.545487 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.546039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.546931 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.550106 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.577508 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-73a9ab2c-9054-4573-bf33-7f091c99afc6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.585359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-73a9ab2c-9054-4573-bf33-7f091c99afc6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1367 microversion: 2.1 time: 0.153541 Jul 18 16:58:29.586000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 412/842] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:29.679766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.688044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.689563 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.690709 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cbf40d70-3573-4b89-a7cb-dd2db4033dea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.160917 Jul 18 16:58:29.691333 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 431/843] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:30.601454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7c023000-f52d-487c-b323-a725a7f3d34b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.601976 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7c023000-f52d-487c-b323-a725a7f3d34b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.608470 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7c023000-f52d-487c-b323-a725a7f3d34b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.608941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7c023000-f52d-487c-b323-a725a7f3d34b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.609705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7c023000-f52d-487c-b323-a725a7f3d34b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.610133 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7c023000-f52d-487c-b323-a725a7f3d34b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.708917 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.710476 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.717013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.717463 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.718494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.718929 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.749373 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7c023000-f52d-487c-b323-a725a7f3d34b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.757210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7c023000-f52d-487c-b323-a725a7f3d34b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1367 microversion: 2.1 time: 0.159619 Jul 18 16:58:30.757986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 413/844] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:30 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:30.855842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.865584 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.867080 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.868235 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a787df67-08ce-4071-bffd-47bf0309f48e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.163361 Jul 18 16:58:30.868789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 432/845] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:30 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:31.552578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-b6557f0f-b23a-4a31-a25a-92ea08d92f4a req-7362130b-2f10-4415-ad65-064033901ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09f72cd-57c2-470c-b58b-60b79684a8d7", "name": "network-vif-plugged", "status": "completed", "tag": "b01a781d-dfe7-4791-b135-427c4cd7eeae"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:31.560636 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-b6557f0f-b23a-4a31-a25a-92ea08d92f4a req-7362130b-2f10-4415-ad65-064033901ab9 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.561113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-b6557f0f-b23a-4a31-a25a-92ea08d92f4a req-7362130b-2f10-4415-ad65-064033901ab9 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.724754 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-b6557f0f-b23a-4a31-a25a-92ea08d92f4a req-7362130b-2f10-4415-ad65-064033901ab9 service nova] Creating event network-vif-plugged:b01a781d-dfe7-4791-b135-427c4cd7eeae for instance c09f72cd-57c2-470c-b58b-60b79684a8d7 on hv-cinder-84617 Jul 18 16:58:31.729966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-b6557f0f-b23a-4a31-a25a-92ea08d92f4a req-7362130b-2f10-4415-ad65-064033901ab9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181677 Jul 18 16:58:31.730618 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 414/846] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:31.773924 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-509d6b2c-4af2-4aeb-add8-d086a545d5ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:31.775125 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-509d6b2c-4af2-4aeb-add8-d086a545d5ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:31.782054 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-509d6b2c-4af2-4aeb-add8-d086a545d5ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.782755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-509d6b2c-4af2-4aeb-add8-d086a545d5ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.784311 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-509d6b2c-4af2-4aeb-add8-d086a545d5ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.784754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-509d6b2c-4af2-4aeb-add8-d086a545d5ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.886874 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:31.888382 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:31.895350 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.896729 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.896987 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:31.897878 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:31.943482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-509d6b2c-4af2-4aeb-add8-d086a545d5ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:31.951867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-509d6b2c-4af2-4aeb-add8-d086a545d5ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1367 microversion: 2.1 time: 0.181831 Jul 18 16:58:31.952537 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 433/847] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:31 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:32.059183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.067551 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.069111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:32.070193 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-45bc6ed5-28a0-4273-9a2b-d4bb19d91a9e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.187755 Jul 18 16:58:32.070745 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 415/848] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:31 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:32.969677 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0b885ba7-8e0f-4467-9121-92b3431ef270 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:32.970291 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0b885ba7-8e0f-4467-9121-92b3431ef270 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:32.977834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0b885ba7-8e0f-4467-9121-92b3431ef270 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.978312 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0b885ba7-8e0f-4467-9121-92b3431ef270 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:32.979077 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0b885ba7-8e0f-4467-9121-92b3431ef270 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:32.979515 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0b885ba7-8e0f-4467-9121-92b3431ef270 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.090321 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:33.090935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:33.097997 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.098443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.099270 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.099701 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.109949 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0b885ba7-8e0f-4467-9121-92b3431ef270 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:33.117979 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0b885ba7-8e0f-4467-9121-92b3431ef270 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1367 microversion: 2.1 time: 0.152158 Jul 18 16:58:33.118566 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 434/849] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:32 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:33.242360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:33.250680 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:33.252172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:33.253338 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9bdb0725-6722-416f-bdc2-9e073f29c882 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.166999 Jul 18 16:58:33.253894 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 416/850] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:33 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:33.745396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-1b23f196-95a4-4410-80e7-b553bd40fd6a req-a138d627-2279-466a-b5a0-da795de1ff75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48753a71-ab88-464c-91fd-21fd8f63c17f", "name": "network-vif-plugged", "status": "completed", "tag": "b47c20c9-b813-4d4c-a62a-1fe35f9924ca"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:33.753988 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-1b23f196-95a4-4410-80e7-b553bd40fd6a req-a138d627-2279-466a-b5a0-da795de1ff75 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:33.761492 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-1b23f196-95a4-4410-80e7-b553bd40fd6a req-a138d627-2279-466a-b5a0-da795de1ff75 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:33.765762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-1b23f196-95a4-4410-80e7-b553bd40fd6a req-a138d627-2279-466a-b5a0-da795de1ff75 service nova] Creating event network-vif-plugged:b47c20c9-b813-4d4c-a62a-1fe35f9924ca for instance 48753a71-ab88-464c-91fd-21fd8f63c17f on hv-cinder-84617 Jul 18 16:58:33.771735 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-1b23f196-95a4-4410-80e7-b553bd40fd6a req-a138d627-2279-466a-b5a0-da795de1ff75 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030523 Jul 18 16:58:33.772556 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 435/851] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:34.134684 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b3fd98b4-30a5-4905-b61a-ae25613b4733 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:34.135288 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b3fd98b4-30a5-4905-b61a-ae25613b4733 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:34.141865 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b3fd98b4-30a5-4905-b61a-ae25613b4733 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.142307 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b3fd98b4-30a5-4905-b61a-ae25613b4733 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.143058 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b3fd98b4-30a5-4905-b61a-ae25613b4733 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.143488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b3fd98b4-30a5-4905-b61a-ae25613b4733 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.272218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:34.273062 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:34.280140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.280684 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.281647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.282094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.283785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b3fd98b4-30a5-4905-b61a-ae25613b4733 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.291808 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b3fd98b4-30a5-4905-b61a-ae25613b4733 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1557 microversion: 2.1 time: 0.160880 Jul 18 16:58:34.292727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 417/852] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:34 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:34.302865 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:34.309195 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6d600b46-d2f1-49f1-bda1-82a3f0b33d49 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:34.309674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6d600b46-d2f1-49f1-bda1-82a3f0b33d49 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:34.318443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d600b46-d2f1-49f1-bda1-82a3f0b33d49 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.318997 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d600b46-d2f1-49f1-bda1-82a3f0b33d49 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.319790 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d600b46-d2f1-49f1-bda1-82a3f0b33d49 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:34.320236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d600b46-d2f1-49f1-bda1-82a3f0b33d49 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:34.418348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6d600b46-d2f1-49f1-bda1-82a3f0b33d49 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113041 Jul 18 16:58:34.418954 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 418/853] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 16:58:34 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:34.480982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.492280 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.494045 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:34.496045 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d925ef1e-8a60-49dd-9ed9-a0bacdc945c7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.228293 Jul 18 16:58:34.497124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 436/854] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:34 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:58:35.433126 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-feb3cfe0-dbee-4e62-8962-87e4b0aff371 req-27b73d92-7d46-4262-b340-8568276b2b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09f72cd-57c2-470c-b58b-60b79684a8d7", "tag": "b01a781d-dfe7-4791-b135-427c4cd7eeae"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:58:35.441740 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-feb3cfe0-dbee-4e62-8962-87e4b0aff371 req-27b73d92-7d46-4262-b340-8568276b2b1c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.442287 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-feb3cfe0-dbee-4e62-8962-87e4b0aff371 req-27b73d92-7d46-4262-b340-8568276b2b1c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:35.453587 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-feb3cfe0-dbee-4e62-8962-87e4b0aff371 req-27b73d92-7d46-4262-b340-8568276b2b1c service nova] Creating event network-changed:b01a781d-dfe7-4791-b135-427c4cd7eeae for instance c09f72cd-57c2-470c-b58b-60b79684a8d7 on hv-cinder-84617 Jul 18 16:58:35.459138 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-feb3cfe0-dbee-4e62-8962-87e4b0aff371 req-27b73d92-7d46-4262-b340-8568276b2b1c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030276 Jul 18 16:58:35.460003 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 419/855] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:58:35.516270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:35.517157 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:35.524724 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.525255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:35.525975 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:35.526467 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:35.672108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:35.683257 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:35.685083 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:35.686705 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-45ef1818-f84d-4612-96c5-8057114bf1db tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.175050 Jul 18 16:58:35.687395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 437/856] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:35 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:36.707157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:36.707903 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:36.714323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:36.714774 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:36.715545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:36.715973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:36.855850 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:36.864799 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:36.866329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:36.867476 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-49d53bf0-0c05-478b-a85f-d7b4ffe2ae2d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1807 microversion: 2.20 time: 0.165686 Jul 18 16:58:36.868029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 420/857] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:36 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:58:37.886254 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:37.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:37.893920 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.894374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:37.895144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:37.895592 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:38.025221 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:38.034487 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:38.036003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:38.037198 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-88b44e90-a47a-404c-8e66-c1b53abac6c4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1794 microversion: 2.20 time: 0.154938 Jul 18 16:58:38.037759 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 438/858] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:58:37 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:11.142682 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1f998a5f-323f-45e9-afa8-a77f166d9297 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:11.143263 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1f998a5f-323f-45e9-afa8-a77f166d9297 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:11.145524 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:11.146178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=86 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:11.150971 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1f998a5f-323f-45e9-afa8-a77f166d9297 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.151421 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1f998a5f-323f-45e9-afa8-a77f166d9297 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.152188 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1f998a5f-323f-45e9-afa8-a77f166d9297 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.152627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1f998a5f-323f-45e9-afa8-a77f166d9297 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.181253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1f998a5f-323f-45e9-afa8-a77f166d9297 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments/34004825-591f-434c-82c0-d7900f353f72" status: 200 len: 194 microversion: 2.20 time: 0.042664 Jul 18 16:59:11.181838 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 421/859] 10.222.0.88 () {60 vars in 1453 bytes} [Mon Jul 18 16:59:11 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments/34004825-591f-434c-82c0-d7900f353f72 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:59:11.245787 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5234adbe-a82f-4ba1-9525-154ed24da0f2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:11.246395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5234adbe-a82f-4ba1-9525-154ed24da0f2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:11.248532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=55 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:11.249375 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=14 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:11.254347 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5234adbe-a82f-4ba1-9525-154ed24da0f2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.255487 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5234adbe-a82f-4ba1-9525-154ed24da0f2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.256350 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5234adbe-a82f-4ba1-9525-154ed24da0f2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.256800 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5234adbe-a82f-4ba1-9525-154ed24da0f2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.341258 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-5234adbe-a82f-4ba1-9525-154ed24da0f2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lazy-loading 'services' on Instance uuid 48753a71-ab88-464c-91fd-21fd8f63c17f {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:59:11.523570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-67a8801a-9f04-4af7-bea2-2b1a1cd62592 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:11.524059 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-67a8801a-9f04-4af7-bea2-2b1a1cd62592 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:11.531116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-67a8801a-9f04-4af7-bea2-2b1a1cd62592 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.531566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-67a8801a-9f04-4af7-bea2-2b1a1cd62592 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.532343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-67a8801a-9f04-4af7-bea2-2b1a1cd62592 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.532772 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-67a8801a-9f04-4af7-bea2-2b1a1cd62592 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.557041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-67a8801a-9f04-4af7-bea2-2b1a1cd62592 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7/ips" status: 200 len: 149 microversion: 2.1 time: 0.037950 Jul 18 16:59:11.557604 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 422/860] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 16:59:11 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:59:11.566731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5234adbe-a82f-4ba1-9525-154ed24da0f2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments/34004825-591f-434c-82c0-d7900f353f72" status: 202 len: 0 microversion: 2.20 time: 0.324927 Jul 18 16:59:11.567318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 439/861] 10.222.0.88 () {60 vars in 1456 bytes} [Mon Jul 18 16:59:11 2022] DELETE /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments/34004825-591f-434c-82c0-d7900f353f72 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:59:11.567678 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "543e8d2b-ee1b-4ebb-a751-60786e571416"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:11.568745 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:11.575859 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.576316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.577129 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.578132 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.582453 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ed8da900-0c1f-40e8-91a4-3ac710df02f8 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:11.582453 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ed8da900-0c1f-40e8-91a4-3ac710df02f8 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:11.587043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ed8da900-0c1f-40e8-91a4-3ac710df02f8 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.587508 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ed8da900-0c1f-40e8-91a4-3ac710df02f8 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.588313 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ed8da900-0c1f-40e8-91a4-3ac710df02f8 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.588757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ed8da900-0c1f-40e8-91a4-3ac710df02f8 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.628575 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ed8da900-0c1f-40e8-91a4-3ac710df02f8 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055681 Jul 18 16:59:11.629192 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 440/862] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 16:59:11 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:59:11.664860 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Invalid volume: volume 543e8d2b-ee1b-4ebb-a751-60786e571416 is already attached to instances: 2733168d-74ec-4dac-a804-6a9f03c2d409 Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: POST /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7/os-volume_attachments HTTP/1.1 Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 74 Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 16:59:11.666683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {"volumeAttachment": {"volumeId": "543e8d2b-ee1b-4ebb-a751-60786e571416"}} Jul 18 16:59:11.669002 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Invalid volume: volume 543e8d2b-ee1b-4ebb-a751-60786e571416 is already attached to instances: 2733168d-74ec-4dac-a804-6a9f03c2d409 Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'server_id': 'c09f72cd-57c2-470c-b58b-60b79684a8d7', 'body': {'volumeAttachment': {'volumeId': '543e8d2b-ee1b-4ebb-a751-60786e571416'}}} Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 543e8d2b-ee1b-4ebb-a751-60786e571416 is already attached to instances: 2733168d-74ec-4dac-a804-6a9f03c2d409 Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:59:11.669940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 543e8d2b-ee1b-4ebb-a751-60786e571416 is already attached to instances: 2733168d-74ec-4dac-a804-6a9f03c2d409 Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:11.671609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:11.673175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:11.673175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:11.673175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:11.673175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 543e8d2b-ee1b-4ebb-a751-60786e571416 is already attached to instances: 2733168d-74ec-4dac-a804-6a9f03c2d409 Jul 18 16:59:11.673175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 16:59:11.673175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 400 to user: Invalid volume: volume 543e8d2b-ee1b-4ebb-a751-60786e571416 is already attached to instances: 2733168d-74ec-4dac-a804-6a9f03c2d409 {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:11.673175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5ecc26a5-b6be-4f81-8c24-15b05903b425 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105413 Jul 18 16:59:11.673175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 423/863] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 16:59:11 2022] POST /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 16:59:11.678906 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-92a2ed37-ecb7-4f68-a685-56f50a98842b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:11.679402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-92a2ed37-ecb7-4f68-a685-56f50a98842b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:11.685914 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-92a2ed37-ecb7-4f68-a685-56f50a98842b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.686385 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-92a2ed37-ecb7-4f68-a685-56f50a98842b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.687173 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-92a2ed37-ecb7-4f68-a685-56f50a98842b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.687620 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-92a2ed37-ecb7-4f68-a685-56f50a98842b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.713301 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-92a2ed37-ecb7-4f68-a685-56f50a98842b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:59:11.930344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-92a2ed37-ecb7-4f68-a685-56f50a98842b tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 204 len: 0 microversion: 2.1 time: 0.254974 Jul 18 16:59:11.930924 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 441/864] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:59:11 2022] DELETE /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:59:11.939103 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b89e5ed2-1924-492d-9412-d07471164ffe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:11.939862 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b89e5ed2-1924-492d-9412-d07471164ffe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:11.946642 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b89e5ed2-1924-492d-9412-d07471164ffe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.951992 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b89e5ed2-1924-492d-9412-d07471164ffe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:11.951992 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b89e5ed2-1924-492d-9412-d07471164ffe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:11.951992 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b89e5ed2-1924-492d-9412-d07471164ffe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:12.081538 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b89e5ed2-1924-492d-9412-d07471164ffe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:12.089022 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b89e5ed2-1924-492d-9412-d07471164ffe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1681 microversion: 2.1 time: 0.153814 Jul 18 16:59:12.090096 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 424/865] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:11 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:12.641943 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-edf0eda2-a058-43a7-96bc-bd5c27713add tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:12.643061 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-edf0eda2-a058-43a7-96bc-bd5c27713add tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:12.649917 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-edf0eda2-a058-43a7-96bc-bd5c27713add tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:12.650371 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-edf0eda2-a058-43a7-96bc-bd5c27713add tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:12.651144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-edf0eda2-a058-43a7-96bc-bd5c27713add tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:12.651588 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-edf0eda2-a058-43a7-96bc-bd5c27713add tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:12.681640 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-edf0eda2-a058-43a7-96bc-bd5c27713add tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044696 Jul 18 16:59:12.682653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 442/866] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 16:59:12 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:59:13.107659 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a5b85d57-c863-4e07-9a71-61bc981f86af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:13.108270 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a5b85d57-c863-4e07-9a71-61bc981f86af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:13.115095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a5b85d57-c863-4e07-9a71-61bc981f86af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:13.115546 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a5b85d57-c863-4e07-9a71-61bc981f86af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:13.116316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a5b85d57-c863-4e07-9a71-61bc981f86af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:13.116754 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a5b85d57-c863-4e07-9a71-61bc981f86af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:13.244490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a5b85d57-c863-4e07-9a71-61bc981f86af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:13.252429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a5b85d57-c863-4e07-9a71-61bc981f86af tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1681 microversion: 2.1 time: 0.148685 Jul 18 16:59:13.253018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 425/867] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:13 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:13.694081 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0f867606-3dc1-4676-a0d5-bf34c8cee922 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:13.695005 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0f867606-3dc1-4676-a0d5-bf34c8cee922 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:13.702352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0f867606-3dc1-4676-a0d5-bf34c8cee922 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:13.702805 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0f867606-3dc1-4676-a0d5-bf34c8cee922 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:13.703608 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0f867606-3dc1-4676-a0d5-bf34c8cee922 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:13.704114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0f867606-3dc1-4676-a0d5-bf34c8cee922 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:13.734516 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0f867606-3dc1-4676-a0d5-bf34c8cee922 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044407 Jul 18 16:59:13.735101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 443/868] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 16:59:13 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:59:14.270299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e0251c0f-754f-4751-966b-c7fa49c13ca2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:14.271522 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e0251c0f-754f-4751-966b-c7fa49c13ca2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:14.278755 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e0251c0f-754f-4751-966b-c7fa49c13ca2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:14.279554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e0251c0f-754f-4751-966b-c7fa49c13ca2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:14.279991 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e0251c0f-754f-4751-966b-c7fa49c13ca2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:14.280432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e0251c0f-754f-4751-966b-c7fa49c13ca2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:14.469644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e0251c0f-754f-4751-966b-c7fa49c13ca2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:14.477503 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e0251c0f-754f-4751-966b-c7fa49c13ca2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1681 microversion: 2.1 time: 0.211322 Jul 18 16:59:14.478082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 426/869] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:14 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:14.747002 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-649bd6dd-1b83-429b-8f14-b4e3b33d3ee2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:14.747922 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-649bd6dd-1b83-429b-8f14-b4e3b33d3ee2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:14.754022 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-649bd6dd-1b83-429b-8f14-b4e3b33d3ee2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:14.754473 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-649bd6dd-1b83-429b-8f14-b4e3b33d3ee2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:14.755255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-649bd6dd-1b83-429b-8f14-b4e3b33d3ee2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:14.755691 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-649bd6dd-1b83-429b-8f14-b4e3b33d3ee2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:14.789429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-649bd6dd-1b83-429b-8f14-b4e3b33d3ee2 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046879 Jul 18 16:59:14.794762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 444/870] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 16:59:14 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:14.839342 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-9c09164e-5a5f-46ac-8bfa-e7b6fcd7e453 req-390440c3-ab22-453b-b014-fa874cdbed8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09f72cd-57c2-470c-b58b-60b79684a8d7", "name": "network-vif-deleted", "tag": "b01a781d-dfe7-4791-b135-427c4cd7eeae"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:14.848127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-9c09164e-5a5f-46ac-8bfa-e7b6fcd7e453 req-390440c3-ab22-453b-b014-fa874cdbed8a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:14.850941 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-9c09164e-5a5f-46ac-8bfa-e7b6fcd7e453 req-390440c3-ab22-453b-b014-fa874cdbed8a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:14.857251 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-28ad3b69-bab3-4fb8-ac25-48015ee0da74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:14.857761 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-28ad3b69-bab3-4fb8-ac25-48015ee0da74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:14.862288 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-9c09164e-5a5f-46ac-8bfa-e7b6fcd7e453 req-390440c3-ab22-453b-b014-fa874cdbed8a service nova] Creating event network-vif-deleted:b01a781d-dfe7-4791-b135-427c4cd7eeae for instance c09f72cd-57c2-470c-b58b-60b79684a8d7 on hv-cinder-84617 Jul 18 16:59:14.864406 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-28ad3b69-bab3-4fb8-ac25-48015ee0da74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:14.864859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-28ad3b69-bab3-4fb8-ac25-48015ee0da74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:14.865653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-28ad3b69-bab3-4fb8-ac25-48015ee0da74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:14.866116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-28ad3b69-bab3-4fb8-ac25-48015ee0da74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:14.868065 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-9c09164e-5a5f-46ac-8bfa-e7b6fcd7e453 req-390440c3-ab22-453b-b014-fa874cdbed8a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032383 Jul 18 16:59:14.868830 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 427/871] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:14.894890 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-28ad3b69-bab3-4fb8-ac25-48015ee0da74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:59:15.206374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-28ad3b69-bab3-4fb8-ac25-48015ee0da74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 204 len: 0 microversion: 2.20 time: 0.352291 Jul 18 16:59:15.207122 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 445/872] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 16:59:14 2022] DELETE /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 16:59:15.216075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:15.217005 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:15.223354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:15.223801 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:15.224566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:15.225086 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:15.364853 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:15.373910 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:15.375434 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:15.376615 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a54dbcc5-7da6-4d78-a2ff-f2ff10afad74 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.164990 Jul 18 16:59:15.377439 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 428/873] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:15 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:59:15.495934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:15.496632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:15.502931 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:15.503371 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:15.504268 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:15.504675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:15.536698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:15.537091 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:15.537533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lazy-loading 'fault' on Instance uuid c09f72cd-57c2-470c-b58b-60b79684a8d7 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:59:15.579290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:15.586694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2a05e885-fc5d-4f62-80a6-452e0623b584 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1331 microversion: 2.1 time: 0.095106 Jul 18 16:59:15.587281 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 446/874] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:15 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:16.394887 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:16.395474 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:16.401888 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:16.402886 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:16.403650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:16.404094 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:16.535043 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:16.543760 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:16.545289 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:16.546478 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5dd83c2c-27c4-4b14-8dea-8e754bfc583a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.155515 Jul 18 16:59:16.547091 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 429/875] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:16 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:16.605329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:16.605937 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:16.613600 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:16.614043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:16.614805 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:16.615234 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:16.649361 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:16.649721 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:16.650170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lazy-loading 'fault' on Instance uuid c09f72cd-57c2-470c-b58b-60b79684a8d7 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:59:16.693217 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:16.701487 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-fdf362e6-f645-45c2-bbe1-e30add50f133 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 200 len: 1331 microversion: 2.1 time: 0.101789 Jul 18 16:59:16.702059 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 447/876] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:16 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:17.564247 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:17.565513 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:17.573578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:17.574087 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:17.574870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:17.575312 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:17.718934 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:17.719539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:17.726474 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:17.726926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:17.727828 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:17.728267 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:17.742739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 HTTP/1.1 Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:59:17.744553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 16:59:17.746101 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': 'c09f72cd-57c2-470c-b58b-60b79684a8d7'} Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:17.746968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 16:59:17.748398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:17.749632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:17.749632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-820a0b52-30fd-4e6c-91eb-de1e74df5bb5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 404 len: 111 microversion: 2.1 time: 0.031674 Jul 18 16:59:17.749632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 448/877] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:17 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:59:17.754694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5cc977b9-d07f-479b-be58-e08824f44b5f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '.version_select at 0x7fd4f9af6ee0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:17.806120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5cc977b9-d07f-479b-be58-e08824f44b5f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292571061" status: 202 len: 0 microversion: 2.1 time: 0.055048 Jul 18 16:59:17.806754 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 449/878] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 16:59:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292571061 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:59:17.821633 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:17.832185 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:17.833708 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:17.834918 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7f675818-925c-4c65-b908-7d5dd3b54892 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1722 microversion: 2.20 time: 0.274555 Jul 18 16:59:17.836334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 430/879] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:17 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:18.010821 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-5c745404-1505-42b3-ab3a-e2ce19afbf2a req-df4c9423-b606-44a0-aa80-6cb6da365cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48753a71-ab88-464c-91fd-21fd8f63c17f", "name": "network-vif-deleted", "tag": "b47c20c9-b813-4d4c-a62a-1fe35f9924ca"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:18.020126 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-5c745404-1505-42b3-ab3a-e2ce19afbf2a req-df4c9423-b606-44a0-aa80-6cb6da365cd4 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:18.020447 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-5c745404-1505-42b3-ab3a-e2ce19afbf2a req-df4c9423-b606-44a0-aa80-6cb6da365cd4 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:18.041674 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-5c745404-1505-42b3-ab3a-e2ce19afbf2a req-df4c9423-b606-44a0-aa80-6cb6da365cd4 service nova] Creating event network-vif-deleted:b47c20c9-b813-4d4c-a62a-1fe35f9924ca for instance 48753a71-ab88-464c-91fd-21fd8f63c17f on hv-cinder-84617 Jul 18 16:59:18.048114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-5c745404-1505-42b3-ab3a-e2ce19afbf2a req-df4c9423-b606-44a0-aa80-6cb6da365cd4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040802 Jul 18 16:59:18.050141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 450/880] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:18.854515 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:18.856932 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:18.869005 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:18.869460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:18.870244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:18.870783 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:18.916254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:18.916715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:18.917232 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lazy-loading 'fault' on Instance uuid 48753a71-ab88-464c-91fd-21fd8f63c17f {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:59:18.975401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:18.983509 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2b829514-10e4-41b9-a89e-531091579cba tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:18.984752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2b829514-10e4-41b9-a89e-531091579cba tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:18.986554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:18.991137 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:18.991137 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5a56e07f-2706-417f-846e-3276274cf536 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 200 len: 1371 microversion: 2.20 time: 0.140516 Jul 18 16:59:18.991665 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 431/881] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:18 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 1371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:18.994768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2b829514-10e4-41b9-a89e-531091579cba tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:18.995313 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2b829514-10e4-41b9-a89e-531091579cba tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:18.996848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2b829514-10e4-41b9-a89e-531091579cba tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:18.997417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2b829514-10e4-41b9-a89e-531091579cba tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:19.089449 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-2b829514-10e4-41b9-a89e-531091579cba tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lazy-loading 'services' on Instance uuid 2733168d-74ec-4dac-a804-6a9f03c2d409 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:59:19.324159 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2b829514-10e4-41b9-a89e-531091579cba tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-volume_attachments/543e8d2b-ee1b-4ebb-a751-60786e571416" status: 202 len: 0 microversion: 2.1 time: 0.345299 Jul 18 16:59:19.327639 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 451/882] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 16:59:18 2022] DELETE /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-volume_attachments/543e8d2b-ee1b-4ebb-a751-60786e571416 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:59:19.333481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2258a832-5e21-4ca6-ac1e-14e7cfde49cd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:19.334475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2258a832-5e21-4ca6-ac1e-14e7cfde49cd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:19.340998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2258a832-5e21-4ca6-ac1e-14e7cfde49cd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:19.341448 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2258a832-5e21-4ca6-ac1e-14e7cfde49cd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:19.342221 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2258a832-5e21-4ca6-ac1e-14e7cfde49cd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:19.342645 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2258a832-5e21-4ca6-ac1e-14e7cfde49cd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:19.372711 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2258a832-5e21-4ca6-ac1e-14e7cfde49cd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043220 Jul 18 16:59:19.373454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 432/883] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:19 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:59:20.010816 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:20.011759 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:20.018803 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:20.019278 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:20.020069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:20.020542 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:20.034738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] HTTP exception thrown: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Request method failure captured: Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f HTTP/1.1 Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZC1zjL_6XS94alptGRAiGmz05TJcOQ_-BSvRg20mCEkxgFEtckxgIIGUkwMr2qOgM-8TXyY9QAgnwSzqK1NUtljjcHOxUWkUp-bqX59mhNLifTQ651gitv35rwNphMTDQeDZ4eypM8PNA4Iso_R1Y69fIhCXDaU4P4yf-4kzHKxYos Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:59:20.041033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/034f143ba31148c0939a06296ec18a96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_034f143ba31148c0939a06296ec18a96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}] Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 24b3c774c1b04537a970c1e7dfdd6ac3 Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 16:59:20.043396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '48753a71-ab88-464c-91fd-21fd8f63c17f'} Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:20.044396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 16:59:20.045948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:20.047290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Returning 404 to user: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:20.047290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ba12c154-d35e-4602-b186-98c67c8ab115 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 404 len: 111 microversion: 2.20 time: 0.031914 Jul 18 16:59:20.047290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 452/884] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:20 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 16:59:20.047603 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1d805d0c-b6d9-4017-88ad-30193ce6ff5c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '.version_select at 0x7fd4f5039040>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:20.137633 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1d805d0c-b6d9-4017-88ad-30193ce6ff5c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961049290" status: 204 len: 0 microversion: 2.20 time: 0.093910 Jul 18 16:59:20.138308 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 433/885] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 16:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961049290 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 16:59:20.384036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-09901591-b10e-4c34-bf84-50c86fc88620 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:20.385065 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-09901591-b10e-4c34-bf84-50c86fc88620 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:20.392206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-09901591-b10e-4c34-bf84-50c86fc88620 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:20.392660 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-09901591-b10e-4c34-bf84-50c86fc88620 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:20.393593 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-09901591-b10e-4c34-bf84-50c86fc88620 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:20.394016 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-09901591-b10e-4c34-bf84-50c86fc88620 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:20.397849 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:20.425574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-09901591-b10e-4c34-bf84-50c86fc88620 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045623 Jul 18 16:59:20.426391 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 453/886] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:20 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:59:20.486593 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6d3c2565-18e7-4c0e-b85f-b1969e9c0f74 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:20.487127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6d3c2565-18e7-4c0e-b85f-b1969e9c0f74 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:20.493355 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d3c2565-18e7-4c0e-b85f-b1969e9c0f74 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:20.493802 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d3c2565-18e7-4c0e-b85f-b1969e9c0f74 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:20.494566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d3c2565-18e7-4c0e-b85f-b1969e9c0f74 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:20.494996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d3c2565-18e7-4c0e-b85f-b1969e9c0f74 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:20.522511 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6d3c2565-18e7-4c0e-b85f-b1969e9c0f74 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:59:20.776207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6d3c2565-18e7-4c0e-b85f-b1969e9c0f74 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 204 len: 0 microversion: 2.1 time: 0.293406 Jul 18 16:59:20.776800 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 434/887] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 16:59:20 2022] DELETE /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:59:20.785116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-eaa09579-907d-4369-b720-71b21795fc7f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:20.786066 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-eaa09579-907d-4369-b720-71b21795fc7f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:20.793567 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eaa09579-907d-4369-b720-71b21795fc7f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:20.796637 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eaa09579-907d-4369-b720-71b21795fc7f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:20.796637 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eaa09579-907d-4369-b720-71b21795fc7f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:20.796637 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eaa09579-907d-4369-b720-71b21795fc7f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:20.956154 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-eaa09579-907d-4369-b720-71b21795fc7f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:20.964187 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-eaa09579-907d-4369-b720-71b21795fc7f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1679 microversion: 2.1 time: 0.183008 Jul 18 16:59:20.964998 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 454/888] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:20 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:21.199001 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-dacdff98-d36e-45c6-b485-8e8cb1813db1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'create', calling method: .version_select at 0x7fd4f5102ca0>, body: {"keypair": {"name": "tempest-keypair-1176525098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmOc8nTMD1wNTS2fJ9LCLwzcni+HfcC0eXyVz2GW+zgqDr4yBkSlu/ryZsYwee1qt6FueFo5Qxsr/sydagQffzMGBo7qMt27ZyE3I8ZLa0KP08LKyNdaG7guWCSg0fZtQ=="}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:21.213481 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-dacdff98-d36e-45c6-b485-8e8cb1813db1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Getting quotas for project 034f143ba31148c0939a06296ec18a96. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:59:21.217111 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-dacdff98-d36e-45c6-b485-8e8cb1813db1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Getting quotas for user 24b3c774c1b04537a970c1e7dfdd6ac3 and project 034f143ba31148c0939a06296ec18a96. Resources: {'key_pairs'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:59:21.303249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-dacdff98-d36e-45c6-b485-8e8cb1813db1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.108743 Jul 18 16:59:21.303862 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 435/889] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 18 16:59:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 16:59:21.981597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9288d7ae-7a97-4e8f-95cd-b158ef9fa7c0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:21.982247 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9288d7ae-7a97-4e8f-95cd-b158ef9fa7c0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:21.989194 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9288d7ae-7a97-4e8f-95cd-b158ef9fa7c0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:21.989609 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9288d7ae-7a97-4e8f-95cd-b158ef9fa7c0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:21.990399 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9288d7ae-7a97-4e8f-95cd-b158ef9fa7c0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:21.990839 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9288d7ae-7a97-4e8f-95cd-b158ef9fa7c0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:22.138747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9288d7ae-7a97-4e8f-95cd-b158ef9fa7c0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:22.146230 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9288d7ae-7a97-4e8f-95cd-b158ef9fa7c0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1679 microversion: 2.1 time: 0.168963 Jul 18 16:59:22.146798 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 455/890] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:21 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:23.164023 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b2084cbc-d436-4ef1-89d5-3192976009f5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:23.164752 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b2084cbc-d436-4ef1-89d5-3192976009f5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:23.171581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b2084cbc-d436-4ef1-89d5-3192976009f5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:23.172028 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b2084cbc-d436-4ef1-89d5-3192976009f5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:23.172773 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b2084cbc-d436-4ef1-89d5-3192976009f5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:23.173226 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b2084cbc-d436-4ef1-89d5-3192976009f5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:23.305285 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b2084cbc-d436-4ef1-89d5-3192976009f5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:23.313912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b2084cbc-d436-4ef1-89d5-3192976009f5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1679 microversion: 2.1 time: 0.154325 Jul 18 16:59:23.314490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 436/891] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:23 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:23.699126 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-186122480", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "922fd4de-8b18-4999-9d76-f017a470f4a8"}], "security_groups": [{"name": "tempest-securitygroup--646243616"}], "key_name": "tempest-keypair-1176525098", "user_data": "}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:23.801006 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] validate_networks() for [('922fd4de-8b18-4999-9d76-f017a470f4a8', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:59:24.176656 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:59:24.177116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:59:24.177594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:59:24.178006 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:59:24.178418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:59:24.187804 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:24.188255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.189124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:24.189570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.205880 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Getting quotas for project 034f143ba31148c0939a06296ec18a96. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:59:24.209830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Getting quotas for user 24b3c774c1b04537a970c1e7dfdd6ac3 and project 034f143ba31148c0939a06296ec18a96. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:59:24.220690 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:59:24.222994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:59:24.334135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-253badde-4c42-48a2-a2b5-dd60ffbd46ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:24.334801 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-253badde-4c42-48a2-a2b5-dd60ffbd46ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:24.341937 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-253badde-4c42-48a2-a2b5-dd60ffbd46ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:24.342387 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-253badde-4c42-48a2-a2b5-dd60ffbd46ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.343153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-253badde-4c42-48a2-a2b5-dd60ffbd46ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:24.343609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-253badde-4c42-48a2-a2b5-dd60ffbd46ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.366020 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bf72e838-dfbc-4d40-a9e7-719d8eaab717 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.671409 Jul 18 16:59:24.367039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 456/892] 10.222.0.88 () {62 vars in 1187 bytes} [Mon Jul 18 16:59:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 16:59:24.376694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4612a80c-045f-4e3e-911e-3f13ffa8d6f0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:24.377323 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4612a80c-045f-4e3e-911e-3f13ffa8d6f0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:24.434107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4612a80c-045f-4e3e-911e-3f13ffa8d6f0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:24.442781 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4612a80c-045f-4e3e-911e-3f13ffa8d6f0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:24.444431 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4612a80c-045f-4e3e-911e-3f13ffa8d6f0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:24.445826 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4612a80c-045f-4e3e-911e-3f13ffa8d6f0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1281 microversion: 2.20 time: 0.073009 Jul 18 16:59:24.446594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 457/893] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:24 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:59:24.486479 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-253badde-4c42-48a2-a2b5-dd60ffbd46ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:24.494578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-253badde-4c42-48a2-a2b5-dd60ffbd46ab tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1679 microversion: 2.1 time: 0.164391 Jul 18 16:59:24.495165 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 437/894] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:24 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:25.463607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:25.464227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:25.471621 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.472076 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.472926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.473331 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.513416 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a61a6e34-d4c7-45f3-826f-18ab1fe42c60 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:25.514140 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a61a6e34-d4c7-45f3-826f-18ab1fe42c60 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:25.521019 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a61a6e34-d4c7-45f3-826f-18ab1fe42c60 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.521793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a61a6e34-d4c7-45f3-826f-18ab1fe42c60 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.522649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a61a6e34-d4c7-45f3-826f-18ab1fe42c60 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.523160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a61a6e34-d4c7-45f3-826f-18ab1fe42c60 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.537893 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:25.545995 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:25.546520 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:25.548102 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:25.549490 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8e9bdfcd-6ce7-455c-b3c1-4db8100c329e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1285 microversion: 2.20 time: 0.089503 Jul 18 16:59:25.552984 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 458/895] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:25 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:25.641508 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a61a6e34-d4c7-45f3-826f-18ab1fe42c60 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:25.661029 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a61a6e34-d4c7-45f3-826f-18ab1fe42c60 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1612 microversion: 2.1 time: 0.152426 Jul 18 16:59:25.662203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 438/896] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:25 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1612 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:25.927511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-25ba3aca-f121-4b3d-9575-1e89bb107205 req-81748d2a-945e-4295-aef9-98648c8e0fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2733168d-74ec-4dac-a804-6a9f03c2d409", "name": "network-vif-deleted", "tag": "2ef11d7b-f237-4db2-a52b-57493a3fb7c8"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:25.949762 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-25ba3aca-f121-4b3d-9575-1e89bb107205 req-81748d2a-945e-4295-aef9-98648c8e0fa0 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.950256 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-25ba3aca-f121-4b3d-9575-1e89bb107205 req-81748d2a-945e-4295-aef9-98648c8e0fa0 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.977827 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-25ba3aca-f121-4b3d-9575-1e89bb107205 req-81748d2a-945e-4295-aef9-98648c8e0fa0 service nova] Creating event network-vif-deleted:2ef11d7b-f237-4db2-a52b-57493a3fb7c8 for instance 2733168d-74ec-4dac-a804-6a9f03c2d409 on hv-cinder-84617 Jul 18 16:59:25.980859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-25ba3aca-f121-4b3d-9575-1e89bb107205 req-81748d2a-945e-4295-aef9-98648c8e0fa0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057020 Jul 18 16:59:25.983044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 459/897] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:26.567165 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:26.567924 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:26.583456 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.583918 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.584709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.585199 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.670890 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:26.681699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:26.682523 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:26.683794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:26.686079 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:26.687574 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8463692a-b479-480f-8d9b-9585ad7cb06e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1341 microversion: 2.20 time: 0.124379 Jul 18 16:59:26.698135 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.698601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.699395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.699863 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.700613 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 439/898] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:26 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1341 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:59:26.734166 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.734619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.735321 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lazy-loading 'fault' on Instance uuid 2733168d-74ec-4dac-a804-6a9f03c2d409 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:59:26.786940 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:26.795144 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-db77cde4-6b99-457b-ba27-d1cf650b612e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 200 len: 1330 microversion: 2.1 time: 0.119788 Jul 18 16:59:26.795718 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 460/899] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:26 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:27.706905 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:27.707644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:27.714551 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.715571 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.716365 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.716804 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.813592 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:27.814288 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:27.822462 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.823282 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.824337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.825585 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.845094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 HTTP/1.1 Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 16:59:27.846834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 16:59:27.848541 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '2733168d-74ec-4dac-a804-6a9f03c2d409'} Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:27.849643 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 16:59:27.851412 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 16:59:27.853629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:27.853629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-60c87bcf-624d-4069-8fa4-deb963f81628 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 404 len: 111 microversion: 2.1 time: 0.041079 Jul 18 16:59:27.853629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 461/900] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:27 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:59:27.861640 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-675504a6-338f-4027-897a-94d91812ab83 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '.version_select at 0x7fd4f9b04f70>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:27.909257 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:27.918114 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:27.920463 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:27.921651 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-4279efaf-4385-41f9-9ceb-2295baf92775 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1406 microversion: 2.20 time: 0.218637 Jul 18 16:59:27.922213 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 440/901] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:27 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:27.951165 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-675504a6-338f-4027-897a-94d91812ab83 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838582699" status: 202 len: 0 microversion: 2.1 time: 0.093491 Jul 18 16:59:27.951753 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 462/902] 10.222.0.88 () {58 vars in 1217 bytes} [Mon Jul 18 16:59:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838582699 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:59:28.699198 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-3a8a73fe-6e89-45e8-8f02-4c7807324411 req-db851800-6a22-4650-9571-e46b18ac7568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "920250a7-2997-49fb-9430-de226b904c0d", "tag": "03d2b05e-f777-497c-a943-ec3d77aa90a3"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:28.721482 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-3a8a73fe-6e89-45e8-8f02-4c7807324411 req-db851800-6a22-4650-9571-e46b18ac7568 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:28.727151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-3a8a73fe-6e89-45e8-8f02-4c7807324411 req-db851800-6a22-4650-9571-e46b18ac7568 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:28.736020 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-3a8a73fe-6e89-45e8-8f02-4c7807324411 req-db851800-6a22-4650-9571-e46b18ac7568 service nova] Creating event network-changed:03d2b05e-f777-497c-a943-ec3d77aa90a3 for instance 920250a7-2997-49fb-9430-de226b904c0d on hv-cinder-84617 Jul 18 16:59:28.741239 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-3a8a73fe-6e89-45e8-8f02-4c7807324411 req-db851800-6a22-4650-9571-e46b18ac7568 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046138 Jul 18 16:59:28.743305 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 441/903] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:28.818566 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0af90339-9dd6-4602-b898-fc1424062c91 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: .version_select at 0x7fd4f9abae50>, body: {"keypair": {"name": "tempest-keypair-1513639572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDuKGnS7DY5hp88LW2vy1KI3CL5FxmI4KrTX2FB2GASNQSdP/32J3e4rH5QPx8UV3nT3RtrAVtzChsPP6TiTnohVIofs4FGPn6Zb7sxbTaaGsZM6K3PICeqM+tTphyWUQ=="}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:28.835351 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-0af90339-9dd6-4602-b898-fc1424062c91 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for project 25de8ee0667645a3864d846675d460e1. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:59:28.839419 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-0af90339-9dd6-4602-b898-fc1424062c91 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for user 730d6426b4ee4cf38893fe2e60b97230 and project 25de8ee0667645a3864d846675d460e1. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:59:28.855637 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:28.940768 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:28.941795 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:28.949159 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:28.953787 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:28.953787 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:28.953787 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:28.971518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0af90339-9dd6-4602-b898-fc1424062c91 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156878 Jul 18 16:59:28.972481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 463/904] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 16:59:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:29.163224 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:29.171974 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:29.173530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:29.174649 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d50827c6-4824-490a-8039-db5e24eaedbd tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1406 microversion: 2.20 time: 0.238232 Jul 18 16:59:29.175213 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 442/905] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:28 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:29.654923 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2034204097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-328566045", "security_groups": [{"name": "tempest-secgroup-smoke-122793974"}], "block_device_mapping_v2": [{"uuid": "d1e67325-fe48-433f-a90b-cffad531b9ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925915ce-ec30-4da0-b91d-e4af79017b65"}]}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:29.776437 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] validate_networks() for [('925915ce-ec30-4da0-b91d-e4af79017b65', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:59:30.166169 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:59:30.170647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:59:30.170647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:59:30.170647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:59:30.170647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:59:30.177692 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:30.178146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:30.178950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:30.179389 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:30.192617 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:30.193252 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:30.200670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:30.201149 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:30.201928 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:30.202369 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:30.202477 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Getting quotas for project 5d68154d9fdb40f0848b676c1fed6a50. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:59:30.208997 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Getting quotas for user cd69c5111dac492a9177128317f0962a and project 5d68154d9fdb40f0848b676c1fed6a50. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:59:30.275822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:59:30.278693 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1e67325-fe48-433f-a90b-cffad531b9ef',volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:59:30.425940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:30.432389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:30.433923 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:30.435637 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1da88051-6f5c-471c-ac9f-7b796fa44104 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1406 microversion: 2.20 time: 0.246969 Jul 18 16:59:30.436204 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 443/906] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:30 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:59:30.803116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1a240366-e5f8-413f-9549-95dcd41489db tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.153033 Jul 18 16:59:30.803770 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 464/907] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:59:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:59:30.813774 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-680fa6bf-a9b2-4772-b194-ef8ef1ef597a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:30.814385 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-680fa6bf-a9b2-4772-b194-ef8ef1ef597a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:30.892471 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-680fa6bf-a9b2-4772-b194-ef8ef1ef597a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:30.900620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-680fa6bf-a9b2-4772-b194-ef8ef1ef597a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1094 microversion: 2.1 time: 0.090669 Jul 18 16:59:30.901248 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 444/908] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:30 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:31.349559 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1127831671", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9ef866c-b807-4e8d-a4b6-a34e3d904b55"}], "security_groups": [{"name": "tempest-securitygroup--277233375"}], "key_name": "tempest-keypair-1513639572", "user_data": "}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:31.453429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] validate_networks() for [('a9ef866c-b807-4e8d-a4b6-a34e3d904b55', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:59:31.454064 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:31.454678 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:31.461048 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:31.461577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:31.462452 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:31.462891 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:31.603739 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:31.612377 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:31.613891 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:31.614981 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-746102db-a186-40ce-b258-ad387cff09ea tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1406 microversion: 2.20 time: 0.165493 Jul 18 16:59:31.615530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 445/909] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:31 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:59:31.834616 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:59:31.835043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:59:31.835663 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:59:31.835990 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:59:31.836401 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:59:31.845454 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:31.847155 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:31.848031 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:31.848442 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:31.868008 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for project 25de8ee0667645a3864d846675d460e1. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:59:31.872384 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for user 730d6426b4ee4cf38893fe2e60b97230 and project 25de8ee0667645a3864d846675d460e1. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:59:31.883337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:59:31.885493 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:59:31.921175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3958a306-a3f6-4ef0-b242-bf2c4bdb4be9 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:31.921785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3958a306-a3f6-4ef0-b242-bf2c4bdb4be9 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:31.927906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3958a306-a3f6-4ef0-b242-bf2c4bdb4be9 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:31.928360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3958a306-a3f6-4ef0-b242-bf2c4bdb4be9 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:31.930189 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3958a306-a3f6-4ef0-b242-bf2c4bdb4be9 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:31.930189 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3958a306-a3f6-4ef0-b242-bf2c4bdb4be9 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:31.994090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3958a306-a3f6-4ef0-b242-bf2c4bdb4be9 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:32.001638 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3958a306-a3f6-4ef0-b242-bf2c4bdb4be9 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1144 microversion: 2.1 time: 0.084785 Jul 18 16:59:32.002211 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 446/910] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:31 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:32.057460 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ac5c223a-aa03-40fa-b1e3-781728cb95f0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.712796 Jul 18 16:59:32.060987 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 465/911] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 16:59:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:59:32.069079 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b03e9a6c-c150-46ca-8e8a-8d600e36a06c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:32.069957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b03e9a6c-c150-46ca-8e8a-8d600e36a06c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:32.128290 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b03e9a6c-c150-46ca-8e8a-8d600e36a06c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:32.150498 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b03e9a6c-c150-46ca-8e8a-8d600e36a06c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1242 microversion: 2.1 time: 0.075457 Jul 18 16:59:32.150498 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 447/912] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:32 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:32.634121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:32.635285 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:32.643557 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:32.644027 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:32.648183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:32.648183 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:32.784493 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:32.792551 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:32.794749 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:32.795892 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7784c63b-24a0-49da-8769-6d94e264713e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1406 microversion: 2.20 time: 0.166459 Jul 18 16:59:32.796454 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 466/913] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:32 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:33.018035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ab85fe45-4a34-4d69-be9f-88b013a18184 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:33.018650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ab85fe45-4a34-4d69-be9f-88b013a18184 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:33.027921 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ab85fe45-4a34-4d69-be9f-88b013a18184 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:33.028632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ab85fe45-4a34-4d69-be9f-88b013a18184 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:33.029731 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ab85fe45-4a34-4d69-be9f-88b013a18184 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:33.030377 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ab85fe45-4a34-4d69-be9f-88b013a18184 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:33.110254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ab85fe45-4a34-4d69-be9f-88b013a18184 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:33.118605 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ab85fe45-4a34-4d69-be9f-88b013a18184 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1200 microversion: 2.1 time: 0.104460 Jul 18 16:59:33.119189 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 448/914] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:33 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:33.157992 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-a686fa31-d4ab-47cc-9d8e-5f7e28cf9132 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:33.158597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-a686fa31-d4ab-47cc-9d8e-5f7e28cf9132 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:33.164689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a686fa31-d4ab-47cc-9d8e-5f7e28cf9132 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:33.165634 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a686fa31-d4ab-47cc-9d8e-5f7e28cf9132 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:33.166238 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a686fa31-d4ab-47cc-9d8e-5f7e28cf9132 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:33.166665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-a686fa31-d4ab-47cc-9d8e-5f7e28cf9132 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:33.258434 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-a686fa31-d4ab-47cc-9d8e-5f7e28cf9132 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:33.266852 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-a686fa31-d4ab-47cc-9d8e-5f7e28cf9132 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1246 microversion: 2.1 time: 0.112406 Jul 18 16:59:33.267785 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 467/915] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:33 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:33.819460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:33.821080 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:33.828960 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:33.829451 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:33.830661 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:33.831388 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:33.984359 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:33.993806 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:33.995457 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:33.997262 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a7b25cb1-f73b-4340-8a5c-6f9aae8510c0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1406 microversion: 2.20 time: 0.182330 Jul 18 16:59:33.998393 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 449/916] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:33 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:34.136240 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b2e1742c-f0f0-45ba-925b-629661cbf417 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:34.137216 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b2e1742c-f0f0-45ba-925b-629661cbf417 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:34.145003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b2e1742c-f0f0-45ba-925b-629661cbf417 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:34.145596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b2e1742c-f0f0-45ba-925b-629661cbf417 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:34.146654 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b2e1742c-f0f0-45ba-925b-629661cbf417 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:34.147629 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b2e1742c-f0f0-45ba-925b-629661cbf417 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:34.284780 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e8ccf912-d5a4-4a47-b2c4-762d2b6621bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:34.287333 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e8ccf912-d5a4-4a47-b2c4-762d2b6621bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:34.294461 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e8ccf912-d5a4-4a47-b2c4-762d2b6621bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:34.295859 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e8ccf912-d5a4-4a47-b2c4-762d2b6621bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:34.296916 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e8ccf912-d5a4-4a47-b2c4-762d2b6621bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:34.297322 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e8ccf912-d5a4-4a47-b2c4-762d2b6621bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:34.322853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b2e1742c-f0f0-45ba-925b-629661cbf417 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:34.333616 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b2e1742c-f0f0-45ba-925b-629661cbf417 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1277 microversion: 2.1 time: 0.201551 Jul 18 16:59:34.334706 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 468/917] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:34 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:34.427378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e8ccf912-d5a4-4a47-b2c4-762d2b6621bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:34.434458 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e8ccf912-d5a4-4a47-b2c4-762d2b6621bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1302 microversion: 2.1 time: 0.154081 Jul 18 16:59:34.434943 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 450/918] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:34 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1302 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:34.787670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-f682d056-4f4d-4721-b867-8561e2ab5ca7 req-e1e9d482-82a0-46bd-ab62-29e955bb591f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920250a7-2997-49fb-9430-de226b904c0d", "name": "network-vif-plugged", "status": "completed", "tag": "03d2b05e-f777-497c-a943-ec3d77aa90a3"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:34.798139 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-f682d056-4f4d-4721-b867-8561e2ab5ca7 req-e1e9d482-82a0-46bd-ab62-29e955bb591f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:34.798591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-f682d056-4f4d-4721-b867-8561e2ab5ca7 req-e1e9d482-82a0-46bd-ab62-29e955bb591f service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:34.810193 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-f682d056-4f4d-4721-b867-8561e2ab5ca7 req-e1e9d482-82a0-46bd-ab62-29e955bb591f service nova] Creating event network-vif-plugged:03d2b05e-f777-497c-a943-ec3d77aa90a3 for instance 920250a7-2997-49fb-9430-de226b904c0d on hv-cinder-84617 Jul 18 16:59:34.815715 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-f682d056-4f4d-4721-b867-8561e2ab5ca7 req-e1e9d482-82a0-46bd-ab62-29e955bb591f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033826 Jul 18 16:59:34.816379 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 469/919] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:35.017165 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:35.017841 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:35.024413 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:35.030136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:35.030136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:35.030136 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:35.346943 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:35.351225 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9bea5a29-9da5-44e6-b5d2-640e32816084 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:35.351927 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9bea5a29-9da5-44e6-b5d2-640e32816084 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:35.357293 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:35.361540 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9bea5a29-9da5-44e6-b5d2-640e32816084 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:35.361688 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:35.361789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9bea5a29-9da5-44e6-b5d2-640e32816084 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:35.361789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9bea5a29-9da5-44e6-b5d2-640e32816084 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:35.361953 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e33cc071-8001-4aa4-aef6-48388bab296a tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1406 microversion: 2.20 time: 0.348722 Jul 18 16:59:35.362036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9bea5a29-9da5-44e6-b5d2-640e32816084 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:35.362134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 451/920] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:35 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:59:35.452432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c7072662-e99c-4fa7-a21d-14cdfa0e8dd5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:35.453076 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c7072662-e99c-4fa7-a21d-14cdfa0e8dd5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:35.459631 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c7072662-e99c-4fa7-a21d-14cdfa0e8dd5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:35.460078 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c7072662-e99c-4fa7-a21d-14cdfa0e8dd5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:35.460847 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c7072662-e99c-4fa7-a21d-14cdfa0e8dd5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:35.461603 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c7072662-e99c-4fa7-a21d-14cdfa0e8dd5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:35.505711 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9bea5a29-9da5-44e6-b5d2-640e32816084 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:35.515574 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9bea5a29-9da5-44e6-b5d2-640e32816084 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.169008 Jul 18 16:59:35.516164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 470/921] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:35 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:35.535781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c7072662-e99c-4fa7-a21d-14cdfa0e8dd5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:35.543613 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c7072662-e99c-4fa7-a21d-14cdfa0e8dd5 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1300 microversion: 2.1 time: 0.095887 Jul 18 16:59:35.544194 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 452/922] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:35 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:35.622441 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-e173aed7-bc5b-4e65-867e-c8b5754a1add req-22dbfaa4-b129-4139-80bc-fdfb3b21c65a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff32d36-ec8b-470f-8b36-0f2299cfadd0", "tag": "342742a0-e5ef-4303-9038-522eb8c8e202"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:35.642757 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-e173aed7-bc5b-4e65-867e-c8b5754a1add req-22dbfaa4-b129-4139-80bc-fdfb3b21c65a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:35.643209 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-e173aed7-bc5b-4e65-867e-c8b5754a1add req-22dbfaa4-b129-4139-80bc-fdfb3b21c65a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:35.665115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-e173aed7-bc5b-4e65-867e-c8b5754a1add req-22dbfaa4-b129-4139-80bc-fdfb3b21c65a service nova] Creating event network-changed:342742a0-e5ef-4303-9038-522eb8c8e202 for instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 on hv-cinder-84617 Jul 18 16:59:35.670924 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-e173aed7-bc5b-4e65-867e-c8b5754a1add req-22dbfaa4-b129-4139-80bc-fdfb3b21c65a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052363 Jul 18 16:59:35.671699 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 471/923] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:36.378264 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:36.378866 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:36.386072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:36.386610 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:36.388168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:36.388687 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:36.532972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f8c926c6-80fb-4eea-9eae-2c50cf9b5fde tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:36.533669 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f8c926c6-80fb-4eea-9eae-2c50cf9b5fde tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:36.540042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f8c926c6-80fb-4eea-9eae-2c50cf9b5fde tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:36.540692 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f8c926c6-80fb-4eea-9eae-2c50cf9b5fde tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:36.541661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f8c926c6-80fb-4eea-9eae-2c50cf9b5fde tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:36.542286 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f8c926c6-80fb-4eea-9eae-2c50cf9b5fde tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:36.651616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:36.661175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:36.663027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:36.664224 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3ab94609-2393-4b1f-b044-c978c1fd1fba tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1406 microversion: 2.20 time: 0.290020 Jul 18 16:59:36.664875 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 453/924] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:36 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:36.670398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-75a0def9-425d-4877-9038-4083fcabc3a6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:36.671077 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-75a0def9-425d-4877-9038-4083fcabc3a6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:36.677240 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75a0def9-425d-4877-9038-4083fcabc3a6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:36.677881 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75a0def9-425d-4877-9038-4083fcabc3a6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:36.678704 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75a0def9-425d-4877-9038-4083fcabc3a6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:36.679143 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-75a0def9-425d-4877-9038-4083fcabc3a6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:36.687926 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f8c926c6-80fb-4eea-9eae-2c50cf9b5fde tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:36.695777 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f8c926c6-80fb-4eea-9eae-2c50cf9b5fde tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.167666 Jul 18 16:59:36.696534 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 472/925] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:36 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:36.916187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-75a0def9-425d-4877-9038-4083fcabc3a6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:36.926683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-75a0def9-425d-4877-9038-4083fcabc3a6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1367 microversion: 2.1 time: 0.260343 Jul 18 16:59:36.937657 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 454/926] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:36 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:37.683112 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:37.683721 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:37.685164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-71ddf137-aae9-44b6-b1af-8162ffb717d5 req-eeeac0e3-e0e8-4a5c-b2bc-819496ee654d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65181ed7-9c92-40b3-b38e-42adcd8d2f20", "tag": "995c2cb3-155c-4c29-bdf4-05a9d26eac6f"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:37.690664 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.691109 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:37.691875 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.692314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:37.693505 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-71ddf137-aae9-44b6-b1af-8162ffb717d5 req-eeeac0e3-e0e8-4a5c-b2bc-819496ee654d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.693949 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-71ddf137-aae9-44b6-b1af-8162ffb717d5 req-eeeac0e3-e0e8-4a5c-b2bc-819496ee654d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:37.705770 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-71ddf137-aae9-44b6-b1af-8162ffb717d5 req-eeeac0e3-e0e8-4a5c-b2bc-819496ee654d service nova] Creating event network-changed:995c2cb3-155c-4c29-bdf4-05a9d26eac6f for instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 on hv-cinder-84617 Jul 18 16:59:37.710608 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-71ddf137-aae9-44b6-b1af-8162ffb717d5 req-eeeac0e3-e0e8-4a5c-b2bc-819496ee654d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029180 Jul 18 16:59:37.711210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 455/927] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:59:37.716750 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-62b6a0ea-52ce-454e-adb7-cd033dcef25d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:37.717480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-62b6a0ea-52ce-454e-adb7-cd033dcef25d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:37.723754 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-62b6a0ea-52ce-454e-adb7-cd033dcef25d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.724209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-62b6a0ea-52ce-454e-adb7-cd033dcef25d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:37.725007 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-62b6a0ea-52ce-454e-adb7-cd033dcef25d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.725449 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-62b6a0ea-52ce-454e-adb7-cd033dcef25d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:37.826790 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:37.835159 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:37.836758 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:37.838033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-17221972-9bbd-4d51-9ce7-f92c49bbd15d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1597 microversion: 2.20 time: 0.158959 Jul 18 16:59:37.838695 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 473/928] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 16:59:37 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:59:37.855352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-601d1292-5e24-4457-b478-9af96b6b6646 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:37.856437 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-601d1292-5e24-4457-b478-9af96b6b6646 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:37.862504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-601d1292-5e24-4457-b478-9af96b6b6646 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.862989 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-601d1292-5e24-4457-b478-9af96b6b6646 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:37.863768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-601d1292-5e24-4457-b478-9af96b6b6646 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.864335 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-601d1292-5e24-4457-b478-9af96b6b6646 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:37.936004 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-62b6a0ea-52ce-454e-adb7-cd033dcef25d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:37.942687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-601d1292-5e24-4457-b478-9af96b6b6646 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091192 Jul 18 16:59:37.943281 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 474/929] 10.222.0.88 () {60 vars in 1315 bytes} [Mon Jul 18 16:59:37 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:59:37.949375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-62b6a0ea-52ce-454e-adb7-cd033dcef25d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.234358 Jul 18 16:59:37.949375 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 456/930] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:37 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:37.958050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-62433b71-d0cd-480b-bcd9-e166a90a01dc tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:37.958050 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-62433b71-d0cd-480b-bcd9-e166a90a01dc tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:37.963531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-62433b71-d0cd-480b-bcd9-e166a90a01dc tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.964010 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-62433b71-d0cd-480b-bcd9-e166a90a01dc tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:37.964778 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-62433b71-d0cd-480b-bcd9-e166a90a01dc tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:37.965785 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-62433b71-d0cd-480b-bcd9-e166a90a01dc tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:38.232257 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-62433b71-d0cd-480b-bcd9-e166a90a01dc tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:38.240261 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-62433b71-d0cd-480b-bcd9-e166a90a01dc tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1367 microversion: 2.1 time: 0.295965 Jul 18 16:59:38.240979 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 475/931] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:37 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:38.963540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e8c919a5-0403-4b77-b8a1-7f0619c0c160 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:38.964157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e8c919a5-0403-4b77-b8a1-7f0619c0c160 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:38.970809 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e8c919a5-0403-4b77-b8a1-7f0619c0c160 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:38.971259 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e8c919a5-0403-4b77-b8a1-7f0619c0c160 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:38.972039 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e8c919a5-0403-4b77-b8a1-7f0619c0c160 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:38.972484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e8c919a5-0403-4b77-b8a1-7f0619c0c160 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:39.141329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e8c919a5-0403-4b77-b8a1-7f0619c0c160 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:39.149303 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e8c919a5-0403-4b77-b8a1-7f0619c0c160 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.189556 Jul 18 16:59:39.150131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 457/932] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:38 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:39.258530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-73590c85-bbe8-4547-ae10-953cf50e10e2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:39.261553 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-73590c85-bbe8-4547-ae10-953cf50e10e2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:39.272436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-73590c85-bbe8-4547-ae10-953cf50e10e2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:39.273204 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-73590c85-bbe8-4547-ae10-953cf50e10e2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:39.274157 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-73590c85-bbe8-4547-ae10-953cf50e10e2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:39.274761 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-73590c85-bbe8-4547-ae10-953cf50e10e2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:39.294516 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-b9a66d04-6c99-480d-8486-52f6d186097b req-04b7aa23-63b0-4b5c-a079-2da6372ff9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "920250a7-2997-49fb-9430-de226b904c0d", "tag": "03d2b05e-f777-497c-a943-ec3d77aa90a3"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:39.300575 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:39.310541 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-b9a66d04-6c99-480d-8486-52f6d186097b req-04b7aa23-63b0-4b5c-a079-2da6372ff9d6 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:39.314597 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-b9a66d04-6c99-480d-8486-52f6d186097b req-04b7aa23-63b0-4b5c-a079-2da6372ff9d6 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:39.332179 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-b9a66d04-6c99-480d-8486-52f6d186097b req-04b7aa23-63b0-4b5c-a079-2da6372ff9d6 service nova] Creating event network-changed:03d2b05e-f777-497c-a943-ec3d77aa90a3 for instance 920250a7-2997-49fb-9430-de226b904c0d on hv-cinder-84617 Jul 18 16:59:39.337574 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-b9a66d04-6c99-480d-8486-52f6d186097b req-04b7aa23-63b0-4b5c-a079-2da6372ff9d6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047214 Jul 18 16:59:39.338124 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 458/933] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:59:39.458269 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-73590c85-bbe8-4547-ae10-953cf50e10e2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:39.467166 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-73590c85-bbe8-4547-ae10-953cf50e10e2 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1367 microversion: 2.1 time: 0.213051 Jul 18 16:59:39.467966 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 476/934] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:39 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:40.169175 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b8798d0d-c943-4fa7-bdfb-b44b45c1829d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:40.169980 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b8798d0d-c943-4fa7-bdfb-b44b45c1829d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:40.176343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b8798d0d-c943-4fa7-bdfb-b44b45c1829d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:40.176805 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b8798d0d-c943-4fa7-bdfb-b44b45c1829d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:40.177776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b8798d0d-c943-4fa7-bdfb-b44b45c1829d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:40.178315 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b8798d0d-c943-4fa7-bdfb-b44b45c1829d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:40.182682 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=100 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:40.394647 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b8798d0d-c943-4fa7-bdfb-b44b45c1829d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:40.403576 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b8798d0d-c943-4fa7-bdfb-b44b45c1829d tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.239884 Jul 18 16:59:40.404164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 459/935] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:40 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:40.484802 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9e5d745e-c590-4586-80c3-53a936cf0f3c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:40.486108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9e5d745e-c590-4586-80c3-53a936cf0f3c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:40.493370 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9e5d745e-c590-4586-80c3-53a936cf0f3c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:40.494105 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9e5d745e-c590-4586-80c3-53a936cf0f3c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:40.503252 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9e5d745e-c590-4586-80c3-53a936cf0f3c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:40.503252 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9e5d745e-c590-4586-80c3-53a936cf0f3c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:40.516029 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:40.639226 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9e5d745e-c590-4586-80c3-53a936cf0f3c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:40.646728 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9e5d745e-c590-4586-80c3-53a936cf0f3c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1367 microversion: 2.1 time: 0.166807 Jul 18 16:59:40.647341 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 477/936] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:40 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:41.426904 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6f7d662e-24ea-4f2a-b1ca-3783f3fc37ba tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:41.427543 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6f7d662e-24ea-4f2a-b1ca-3783f3fc37ba tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:41.434863 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f7d662e-24ea-4f2a-b1ca-3783f3fc37ba tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:41.435316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f7d662e-24ea-4f2a-b1ca-3783f3fc37ba tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:41.436089 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f7d662e-24ea-4f2a-b1ca-3783f3fc37ba tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:41.436534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f7d662e-24ea-4f2a-b1ca-3783f3fc37ba tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:41.572450 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6f7d662e-24ea-4f2a-b1ca-3783f3fc37ba tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:41.580632 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6f7d662e-24ea-4f2a-b1ca-3783f3fc37ba tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.157630 Jul 18 16:59:41.581251 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 460/937] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:41 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:41.663596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-64b70db0-0448-417e-be0d-e2953b4fe88a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:41.664164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-64b70db0-0448-417e-be0d-e2953b4fe88a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:41.670796 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-64b70db0-0448-417e-be0d-e2953b4fe88a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:41.671248 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-64b70db0-0448-417e-be0d-e2953b4fe88a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:41.672019 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-64b70db0-0448-417e-be0d-e2953b4fe88a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:41.672510 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-64b70db0-0448-417e-be0d-e2953b4fe88a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:41.803726 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-64b70db0-0448-417e-be0d-e2953b4fe88a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:41.811555 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-64b70db0-0448-417e-be0d-e2953b4fe88a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1367 microversion: 2.1 time: 0.151919 Jul 18 16:59:41.812118 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 478/938] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:41 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:42.597194 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5f85e0b5-138c-43f8-852d-9fd4f2aba1b7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:42.597927 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5f85e0b5-138c-43f8-852d-9fd4f2aba1b7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:42.599704 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=8 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:42.605020 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5f85e0b5-138c-43f8-852d-9fd4f2aba1b7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:42.605499 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5f85e0b5-138c-43f8-852d-9fd4f2aba1b7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:42.606222 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5f85e0b5-138c-43f8-852d-9fd4f2aba1b7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:42.611381 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5f85e0b5-138c-43f8-852d-9fd4f2aba1b7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:42.746962 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5f85e0b5-138c-43f8-852d-9fd4f2aba1b7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:42.755010 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5f85e0b5-138c-43f8-852d-9fd4f2aba1b7 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.161627 Jul 18 16:59:42.755604 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 461/939] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:42 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:42.792634 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-e97ba920-34f6-42ed-b6fb-0369ad563eea req-edbd3598-933c-425a-859a-04ba0d119bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65181ed7-9c92-40b3-b38e-42adcd8d2f20", "name": "network-vif-plugged", "status": "completed", "tag": "995c2cb3-155c-4c29-bdf4-05a9d26eac6f"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:42.798169 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=6 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:42.798858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=24 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:42.804677 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-e97ba920-34f6-42ed-b6fb-0369ad563eea req-edbd3598-933c-425a-859a-04ba0d119bf3 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:42.805078 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-e97ba920-34f6-42ed-b6fb-0369ad563eea req-edbd3598-933c-425a-859a-04ba0d119bf3 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:42.817888 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-e97ba920-34f6-42ed-b6fb-0369ad563eea req-edbd3598-933c-425a-859a-04ba0d119bf3 service nova] Creating event network-vif-plugged:995c2cb3-155c-4c29-bdf4-05a9d26eac6f for instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 on hv-cinder-84617 Jul 18 16:59:42.822969 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-e97ba920-34f6-42ed-b6fb-0369ad563eea req-edbd3598-933c-425a-859a-04ba0d119bf3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Jul 18 16:59:42.823568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 479/940] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:59:42.829123 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f1fd8f6d-cae8-42cb-9e35-f702ab0068a4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:42.829727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f1fd8f6d-cae8-42cb-9e35-f702ab0068a4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:42.836127 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f1fd8f6d-cae8-42cb-9e35-f702ab0068a4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:42.836796 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f1fd8f6d-cae8-42cb-9e35-f702ab0068a4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:42.837613 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f1fd8f6d-cae8-42cb-9e35-f702ab0068a4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:42.838053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f1fd8f6d-cae8-42cb-9e35-f702ab0068a4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:42.978026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f1fd8f6d-cae8-42cb-9e35-f702ab0068a4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:42.985574 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f1fd8f6d-cae8-42cb-9e35-f702ab0068a4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1367 microversion: 2.1 time: 0.160284 Jul 18 16:59:42.986143 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 462/941] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:42 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:43.773153 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7159c4f2-3c7d-45dd-a150-d7dc0522ce70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:43.773879 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7159c4f2-3c7d-45dd-a150-d7dc0522ce70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:43.781177 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7159c4f2-3c7d-45dd-a150-d7dc0522ce70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:43.781631 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7159c4f2-3c7d-45dd-a150-d7dc0522ce70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:43.782396 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7159c4f2-3c7d-45dd-a150-d7dc0522ce70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:43.782834 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7159c4f2-3c7d-45dd-a150-d7dc0522ce70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:43.918472 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7159c4f2-3c7d-45dd-a150-d7dc0522ce70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:43.926164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7159c4f2-3c7d-45dd-a150-d7dc0522ce70 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.157968 Jul 18 16:59:43.935988 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 480/942] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:43 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:44.002167 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0ae92c99-217b-49b8-b11f-5e5707ba4104 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:44.002775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0ae92c99-217b-49b8-b11f-5e5707ba4104 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:44.009345 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0ae92c99-217b-49b8-b11f-5e5707ba4104 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:44.009871 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0ae92c99-217b-49b8-b11f-5e5707ba4104 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:44.010581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0ae92c99-217b-49b8-b11f-5e5707ba4104 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:44.011019 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0ae92c99-217b-49b8-b11f-5e5707ba4104 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:44.145187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0ae92c99-217b-49b8-b11f-5e5707ba4104 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:44.153170 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0ae92c99-217b-49b8-b11f-5e5707ba4104 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1367 microversion: 2.1 time: 0.154298 Jul 18 16:59:44.153668 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 463/943] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:43 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:44.943941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-778785a5-0063-4d28-bcae-09b3eb63dca1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:44.944813 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-778785a5-0063-4d28-bcae-09b3eb63dca1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:44.953127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-778785a5-0063-4d28-bcae-09b3eb63dca1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:44.953586 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-778785a5-0063-4d28-bcae-09b3eb63dca1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:44.954367 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-778785a5-0063-4d28-bcae-09b3eb63dca1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:44.954814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-778785a5-0063-4d28-bcae-09b3eb63dca1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:45.102065 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-778785a5-0063-4d28-bcae-09b3eb63dca1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:45.110166 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-778785a5-0063-4d28-bcae-09b3eb63dca1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.170183 Jul 18 16:59:45.110749 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 481/944] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:44 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:45.170411 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-11789af6-fa58-4ea3-be06-95b3806e0e30 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:45.171041 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-11789af6-fa58-4ea3-be06-95b3806e0e30 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:45.177672 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-11789af6-fa58-4ea3-be06-95b3806e0e30 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:45.178134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-11789af6-fa58-4ea3-be06-95b3806e0e30 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:45.178886 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-11789af6-fa58-4ea3-be06-95b3806e0e30 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:45.179324 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-11789af6-fa58-4ea3-be06-95b3806e0e30 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:45.315183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-11789af6-fa58-4ea3-be06-95b3806e0e30 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:45.323864 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-11789af6-fa58-4ea3-be06-95b3806e0e30 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1556 microversion: 2.1 time: 0.157771 Jul 18 16:59:45.324451 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 464/945] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:45 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:45.340172 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c2830b8e-a8ff-4bda-ab2d-a29cd872798d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:45.340665 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c2830b8e-a8ff-4bda-ab2d-a29cd872798d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:45.346723 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c2830b8e-a8ff-4bda-ab2d-a29cd872798d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:45.347177 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c2830b8e-a8ff-4bda-ab2d-a29cd872798d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:45.347948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c2830b8e-a8ff-4bda-ab2d-a29cd872798d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:45.348386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c2830b8e-a8ff-4bda-ab2d-a29cd872798d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:45.425388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c2830b8e-a8ff-4bda-ab2d-a29cd872798d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088984 Jul 18 16:59:45.426001 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 482/946] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 16:59:45 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:46.128113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9225c1a9-5aad-4e8b-b804-8de3312f0d09 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:46.128907 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9225c1a9-5aad-4e8b-b804-8de3312f0d09 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:46.135141 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9225c1a9-5aad-4e8b-b804-8de3312f0d09 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:46.135597 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9225c1a9-5aad-4e8b-b804-8de3312f0d09 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:46.136382 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9225c1a9-5aad-4e8b-b804-8de3312f0d09 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:46.136821 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9225c1a9-5aad-4e8b-b804-8de3312f0d09 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:46.271835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9225c1a9-5aad-4e8b-b804-8de3312f0d09 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:46.280784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9225c1a9-5aad-4e8b-b804-8de3312f0d09 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.155803 Jul 18 16:59:46.280784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 465/947] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:46 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:46.418242 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-16814210-974b-4d0d-81cb-8a65fb777a0f req-9335274b-6a35-40dd-8de2-6b9f729883eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65181ed7-9c92-40b3-b38e-42adcd8d2f20", "tag": "995c2cb3-155c-4c29-bdf4-05a9d26eac6f"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:46.427549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-16814210-974b-4d0d-81cb-8a65fb777a0f req-9335274b-6a35-40dd-8de2-6b9f729883eb service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:46.428068 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-16814210-974b-4d0d-81cb-8a65fb777a0f req-9335274b-6a35-40dd-8de2-6b9f729883eb service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:46.439539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-16814210-974b-4d0d-81cb-8a65fb777a0f req-9335274b-6a35-40dd-8de2-6b9f729883eb service nova] Creating event network-changed:995c2cb3-155c-4c29-bdf4-05a9d26eac6f for instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 on hv-cinder-84617 Jul 18 16:59:46.445145 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-16814210-974b-4d0d-81cb-8a65fb777a0f req-9335274b-6a35-40dd-8de2-6b9f729883eb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030558 Jul 18 16:59:46.445755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 483/948] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:47.297572 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6f4013a2-9eb2-4b04-86e8-3c1f95fe4e4f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:47.298225 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6f4013a2-9eb2-4b04-86e8-3c1f95fe4e4f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:47.305057 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f4013a2-9eb2-4b04-86e8-3c1f95fe4e4f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:47.305426 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f4013a2-9eb2-4b04-86e8-3c1f95fe4e4f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:47.306187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f4013a2-9eb2-4b04-86e8-3c1f95fe4e4f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:47.306761 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f4013a2-9eb2-4b04-86e8-3c1f95fe4e4f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:47.461085 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6f4013a2-9eb2-4b04-86e8-3c1f95fe4e4f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:47.469337 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6f4013a2-9eb2-4b04-86e8-3c1f95fe4e4f tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.176347 Jul 18 16:59:47.470617 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 466/949] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:47 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:48.488640 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-341a6425-b74a-4201-9d4f-28c58cdcfa01 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:48.489371 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-341a6425-b74a-4201-9d4f-28c58cdcfa01 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:48.496178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-341a6425-b74a-4201-9d4f-28c58cdcfa01 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:48.496632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-341a6425-b74a-4201-9d4f-28c58cdcfa01 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:48.497426 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-341a6425-b74a-4201-9d4f-28c58cdcfa01 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:48.497866 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-341a6425-b74a-4201-9d4f-28c58cdcfa01 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:48.636135 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-341a6425-b74a-4201-9d4f-28c58cdcfa01 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:48.645026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-341a6425-b74a-4201-9d4f-28c58cdcfa01 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.159660 Jul 18 16:59:48.645198 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 484/950] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:48 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:49.023155 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-75052a1f-ff49-4e9f-bafb-532114ecf26e req-a0d3cbe8-f3d9-444d-b605-2ffed8f38c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff32d36-ec8b-470f-8b36-0f2299cfadd0", "name": "network-vif-plugged", "status": "completed", "tag": "342742a0-e5ef-4303-9038-522eb8c8e202"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:49.032323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-75052a1f-ff49-4e9f-bafb-532114ecf26e req-a0d3cbe8-f3d9-444d-b605-2ffed8f38c00 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:49.032776 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-75052a1f-ff49-4e9f-bafb-532114ecf26e req-a0d3cbe8-f3d9-444d-b605-2ffed8f38c00 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:49.043856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-75052a1f-ff49-4e9f-bafb-532114ecf26e req-a0d3cbe8-f3d9-444d-b605-2ffed8f38c00 service nova] Creating event network-vif-plugged:342742a0-e5ef-4303-9038-522eb8c8e202 for instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 on hv-cinder-84617 Jul 18 16:59:49.049096 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-75052a1f-ff49-4e9f-bafb-532114ecf26e req-a0d3cbe8-f3d9-444d-b605-2ffed8f38c00 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029626 Jul 18 16:59:49.049702 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 467/951] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:49.661937 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-95d1eea8-93d6-4b91-9fab-e26ed4060319 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:49.662468 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-95d1eea8-93d6-4b91-9fab-e26ed4060319 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:49.668976 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-95d1eea8-93d6-4b91-9fab-e26ed4060319 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:49.669937 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-95d1eea8-93d6-4b91-9fab-e26ed4060319 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:49.670707 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-95d1eea8-93d6-4b91-9fab-e26ed4060319 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:49.671138 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-95d1eea8-93d6-4b91-9fab-e26ed4060319 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:49.808619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-95d1eea8-93d6-4b91-9fab-e26ed4060319 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:49.816820 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-95d1eea8-93d6-4b91-9fab-e26ed4060319 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.158868 Jul 18 16:59:49.817441 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 485/952] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:49 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:50.836241 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ac846440-d45d-4463-a9a5-df1326aa6ffe tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:50.836947 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ac846440-d45d-4463-a9a5-df1326aa6ffe tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:50.843614 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ac846440-d45d-4463-a9a5-df1326aa6ffe tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:50.844055 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ac846440-d45d-4463-a9a5-df1326aa6ffe tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:50.844803 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ac846440-d45d-4463-a9a5-df1326aa6ffe tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:50.845255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ac846440-d45d-4463-a9a5-df1326aa6ffe tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:50.978078 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ac846440-d45d-4463-a9a5-df1326aa6ffe tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:50.986182 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ac846440-d45d-4463-a9a5-df1326aa6ffe tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1265 microversion: 2.1 time: 0.154624 Jul 18 16:59:50.986754 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 468/953] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:50 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:52.002982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9f3f176d-0b60-4fcc-add2-f5d1258a6b4b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:52.003593 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9f3f176d-0b60-4fcc-add2-f5d1258a6b4b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:52.010275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9f3f176d-0b60-4fcc-add2-f5d1258a6b4b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:52.010725 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9f3f176d-0b60-4fcc-add2-f5d1258a6b4b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:52.011505 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9f3f176d-0b60-4fcc-add2-f5d1258a6b4b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:52.011948 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9f3f176d-0b60-4fcc-add2-f5d1258a6b4b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:52.143592 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9f3f176d-0b60-4fcc-add2-f5d1258a6b4b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:52.151190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9f3f176d-0b60-4fcc-add2-f5d1258a6b4b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1451 microversion: 2.1 time: 0.152104 Jul 18 16:59:52.151769 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 486/954] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:51 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:52.167504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-84853dc1-787b-4e3f-8c27-5d168a094e15 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:52.168563 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-84853dc1-787b-4e3f-8c27-5d168a094e15 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:52.175472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-84853dc1-787b-4e3f-8c27-5d168a094e15 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:52.175920 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-84853dc1-787b-4e3f-8c27-5d168a094e15 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:52.176691 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-84853dc1-787b-4e3f-8c27-5d168a094e15 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:52.177160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-84853dc1-787b-4e3f-8c27-5d168a094e15 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:52.311915 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-84853dc1-787b-4e3f-8c27-5d168a094e15 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:52.319742 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-84853dc1-787b-4e3f-8c27-5d168a094e15 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1451 microversion: 2.1 time: 0.156075 Jul 18 16:59:52.320325 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 469/955] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:52 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:54.502327 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-90451692-882b-486a-8805-07fb8c0342f0 req-c8ad7d4d-d85d-41bc-98a3-8dc195063034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff32d36-ec8b-470f-8b36-0f2299cfadd0", "tag": "342742a0-e5ef-4303-9038-522eb8c8e202"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:59:54.511486 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-90451692-882b-486a-8805-07fb8c0342f0 req-c8ad7d4d-d85d-41bc-98a3-8dc195063034 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:54.513724 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-90451692-882b-486a-8805-07fb8c0342f0 req-c8ad7d4d-d85d-41bc-98a3-8dc195063034 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:54.526381 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-90451692-882b-486a-8805-07fb8c0342f0 req-c8ad7d4d-d85d-41bc-98a3-8dc195063034 service nova] Creating event network-changed:342742a0-e5ef-4303-9038-522eb8c8e202 for instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 on hv-cinder-84617 Jul 18 16:59:54.531817 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-90451692-882b-486a-8805-07fb8c0342f0 req-c8ad7d4d-d85d-41bc-98a3-8dc195063034 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033068 Jul 18 16:59:54.532589 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 487/956] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 16:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:15.448836 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-379380ad-206a-4e4c-b282-4251484ee6ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:15.449453 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-379380ad-206a-4e4c-b282-4251484ee6ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:15.452072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=22 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:15.452798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=60 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:15.457560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-379380ad-206a-4e4c-b282-4251484ee6ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:15.458016 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-379380ad-206a-4e4c-b282-4251484ee6ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:15.458789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-379380ad-206a-4e4c-b282-4251484ee6ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:15.459230 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-379380ad-206a-4e4c-b282-4251484ee6ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:15.489257 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-379380ad-206a-4e4c-b282-4251484ee6ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/ips" status: 200 len: 150 microversion: 2.20 time: 0.044276 Jul 18 17:00:15.489838 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 470/957] 10.222.0.88 () {60 vars in 1288 bytes} [Mon Jul 18 17:00:15 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 17:00:18.118594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:18.119467 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=48 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:18.123859 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d1f26d23-11b8-45d7-983d-6a4595ba2485 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:18.125192 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d1f26d23-11b8-45d7-983d-6a4595ba2485 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:18.133180 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1f26d23-11b8-45d7-983d-6a4595ba2485 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:18.137842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1f26d23-11b8-45d7-983d-6a4595ba2485 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:18.137842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1f26d23-11b8-45d7-983d-6a4595ba2485 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:18.137842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1f26d23-11b8-45d7-983d-6a4595ba2485 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:18.159149 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-d1f26d23-11b8-45d7-983d-6a4595ba2485 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lazy-loading 'flavor' on Instance uuid 920250a7-2997-49fb-9430-de226b904c0d {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:00:18.777628 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:00:18.778343 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 17:00:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:00:18.838943 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d1f26d23-11b8-45d7-983d-6a4595ba2485 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/action" status: 202 len: 0 microversion: 2.20 time: 0.721843 Jul 18 17:00:18.839568 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 488/958] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 17:00:18 2022] POST /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:00:18.847780 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:18.848399 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:18.855012 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:18.860936 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:18.860936 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:18.860936 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:19.051321 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:19.059554 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:19.061098 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:19.062782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ebbf98ca-3e4f-489b-bd43-2bb2a6c69f02 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.219057 Jul 18 17:00:19.063352 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 471/959] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:18 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:20.083098 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:20.083783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:20.090135 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:20.090579 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:20.091333 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:20.091768 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:20.227182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:20.235917 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:20.237499 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:20.238734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-35e2d83a-af4b-4805-b022-3ac677c2f2c9 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.160367 Jul 18 17:00:20.239298 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 489/960] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:20 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:21.257151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:21.257769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:21.264358 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:21.265360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:21.266129 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:21.266570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:21.402944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:21.413467 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:21.414944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:21.416093 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8876e1dc-9b8e-43fd-9bf6-9c5856f0a1ce tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.162901 Jul 18 17:00:21.416655 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 472/961] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:21 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:22.434494 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:22.435104 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:22.442274 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:22.442731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:22.443766 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:22.444206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:22.572728 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:22.581302 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:22.582811 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:22.583971 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-85f71341-5d21-49ee-aaba-5d9844cfaacb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.153417 Jul 18 17:00:22.584538 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 490/962] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:22 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:23.602726 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:23.603320 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:23.609953 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:23.610407 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:23.611170 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:23.611609 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:23.742052 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:23.749935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:23.751429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:23.752572 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-76208cf1-be94-4267-9b21-b5a9b6303189 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.154025 Jul 18 17:00:23.753166 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 473/963] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:23 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:24.771176 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:24.771856 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:24.778560 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:24.779013 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:24.779783 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:24.780842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:24.912866 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:24.921469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:24.922979 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:24.924133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3acc583e-6824-4e63-9878-720c00cabe37 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.156943 Jul 18 17:00:24.924694 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 491/964] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:24 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:25.942065 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:25.942675 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:25.949601 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:25.950054 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:25.950821 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:25.951257 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:26.084027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:26.091998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:26.093523 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:26.094677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-815a875e-045c-44e2-9174-b03520068303 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.156547 Jul 18 17:00:26.095246 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 474/965] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:25 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:00:27.113936 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:27.114544 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:27.121385 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:27.121832 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:27.122703 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:27.123146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:27.259318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:27.267951 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:27.269495 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:27.270656 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8fab8dfa-d81f-45b0-a09a-9f67f874a666 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.160718 Jul 18 17:00:27.271256 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 492/966] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:27 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:28.288737 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:28.289415 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:28.295921 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:28.296367 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:28.297168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:28.297606 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:28.427026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:28.435004 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:28.437074 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:28.438325 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-95491f4b-fcaa-4aa5-8ebe-e46881400ea4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.153388 Jul 18 17:00:28.438789 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 475/967] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:28 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:29.456797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:29.457440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:29.464006 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:29.464459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:29.465259 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:29.465703 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:29.604196 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:29.612036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:29.613862 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:29.614731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-18a61593-cef2-47ca-a0c9-6314f247ca70 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.161865 Jul 18 17:00:29.615319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 493/968] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:29 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:30.285572 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-666363a6-c164-4b6e-8208-5fdf6f6ffe26 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:30.286145 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-666363a6-c164-4b6e-8208-5fdf6f6ffe26 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:30.292606 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-666363a6-c164-4b6e-8208-5fdf6f6ffe26 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.293100 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-666363a6-c164-4b6e-8208-5fdf6f6ffe26 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.293871 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-666363a6-c164-4b6e-8208-5fdf6f6ffe26 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.294336 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-666363a6-c164-4b6e-8208-5fdf6f6ffe26 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.317511 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-666363a6-c164-4b6e-8208-5fdf6f6ffe26 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/ips" status: 200 len: 149 microversion: 2.1 time: 0.035805 Jul 18 17:00:30.318437 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 476/969] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 17:00:30 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:30.633621 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:30.634257 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:30.641151 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.641593 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.642358 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.642798 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.776098 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:30.785047 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:30.786571 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:30.787729 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c5e9c3c1-7a7b-4357-a93e-9a01f0ddc43c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.158232 Jul 18 17:00:30.788290 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 494/970] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:30 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:31.806038 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:31.806645 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:31.813957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:31.814403 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:31.815165 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:31.815601 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:31.928591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9a0db418-09f3-46b6-a1f0-b574e71e6b03 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d4ff192-25cf-4745-91e4-34853a77d07b"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:31.929756 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9a0db418-09f3-46b6-a1f0-b574e71e6b03 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:31.936578 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9a0db418-09f3-46b6-a1f0-b574e71e6b03 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:31.936794 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9a0db418-09f3-46b6-a1f0-b574e71e6b03 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:31.937530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9a0db418-09f3-46b6-a1f0-b574e71e6b03 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:31.937965 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9a0db418-09f3-46b6-a1f0-b574e71e6b03 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:31.954148 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:31.962032 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:31.963539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:31.964697 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-237b97c4-2091-4528-96ee-4a76f6b11a3b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.162633 Jul 18 17:00:31.965293 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 477/971] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:31 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:32.744394 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9a0db418-09f3-46b6-a1f0-b574e71e6b03 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.819658 Jul 18 17:00:32.745042 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 495/972] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 17:00:31 2022] POST /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:00:32.983621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:32.997445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:32.997445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:32.997445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:32.997445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:32.997859 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:33.126653 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:33.134428 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:33.135963 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:33.137119 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-d0e45a06-9e51-4e83-84f0-fc7812effc5f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.157596 Jul 18 17:00:33.140382 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 478/973] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:32 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:34.157104 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:34.157801 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:34.164074 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:34.164532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:34.165343 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:34.165786 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:34.297806 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:34.305839 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:34.307340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:34.308482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8894c19e-0497-464e-b0b3-7333c211a374 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.156637 Jul 18 17:00:34.309081 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 496/974] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:34 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:35.327316 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:35.327903 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:35.334407 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:35.334852 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:35.335601 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:35.336035 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:35.468527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:35.476611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:35.478135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:35.479296 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-98145340-44d2-4510-a8f5-50120a39f874 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1742 microversion: 2.20 time: 0.155926 Jul 18 17:00:35.479976 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 479/975] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:35 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:36.499107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:36.499808 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:36.508523 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:36.509055 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:36.509797 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:36.510271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:36.648302 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:36.656867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:36.658437 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:36.659644 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b262b590-ca68-4416-994c-53d3f1a167a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1742 microversion: 2.20 time: 0.165050 Jul 18 17:00:36.660209 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 497/976] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:36 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:37.677845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:37.678433 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:37.688725 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:37.689562 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:37.690699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:37.691134 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:37.856735 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:37.865892 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:37.869166 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:37.870859 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5b681e84-f5f6-4ceb-a482-9d26cfa059f6 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.196930 Jul 18 17:00:37.871443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 480/977] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:37 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:38.901779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:38.903221 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:38.921587 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:38.922276 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:38.923764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:38.924364 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:39.012257 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-c0b8d77e-133b-4697-a2f8-e5b1872f6df5 req-90a30533-8d21-4826-9fec-3a0647531d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920250a7-2997-49fb-9430-de226b904c0d", "name": "network-vif-plugged", "status": "completed", "tag": "03d2b05e-f777-497c-a943-ec3d77aa90a3"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:39.024535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-c0b8d77e-133b-4697-a2f8-e5b1872f6df5 req-90a30533-8d21-4826-9fec-3a0647531d51 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:39.025376 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-c0b8d77e-133b-4697-a2f8-e5b1872f6df5 req-90a30533-8d21-4826-9fec-3a0647531d51 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:39.046014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-c0b8d77e-133b-4697-a2f8-e5b1872f6df5 req-90a30533-8d21-4826-9fec-3a0647531d51 service nova] Creating event network-vif-plugged:03d2b05e-f777-497c-a943-ec3d77aa90a3 for instance 920250a7-2997-49fb-9430-de226b904c0d on hv-cinder-84617 Jul 18 17:00:39.052034 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-c0b8d77e-133b-4697-a2f8-e5b1872f6df5 req-90a30533-8d21-4826-9fec-3a0647531d51 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043311 Jul 18 17:00:39.052568 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 481/978] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:39.103481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:39.114360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:39.128237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:39.128237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9cd8cedd-ca1a-48c9-9ff4-c673156d5c3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.231236 Jul 18 17:00:39.128237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 498/979] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:38 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:40.136692 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:40.137413 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:40.143865 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:40.144378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:40.145164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:40.145593 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:40.296412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:40.305355 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:40.307052 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:40.308444 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-aaeada49-9122-4e24-97d4-332ddafdc703 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.176500 Jul 18 17:00:40.309398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 482/980] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:40 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:41.335615 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:41.336827 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:41.344458 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:41.345263 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:41.346314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:41.346971 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:41.403611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d4ff192-25cf-4745-91e4-34853a77d07b"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:41.407406 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:41.416514 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:41.417323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:41.418299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:41.418744 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:41.515576 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:41.523898 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Invalid volume: volume 3d4ff192-25cf-4745-91e4-34853a77d07b is already attached to instances: 65181ed7-9c92-40b3-b38e-42adcd8d2f20 Jul 18 17:00:41.524116 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:41.525475 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: POST /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments HTTP/1.1 Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 74 Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:00:41.525844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {"volumeAttachment": {"volumeId": "3d4ff192-25cf-4745-91e4-34853a77d07b"}} Jul 18 17:00:41.527286 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Invalid volume: volume 3d4ff192-25cf-4745-91e4-34853a77d07b is already attached to instances: 65181ed7-9c92-40b3-b38e-42adcd8d2f20 Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'server_id': '65181ed7-9c92-40b3-b38e-42adcd8d2f20', 'body': {'volumeAttachment': {'volumeId': '3d4ff192-25cf-4745-91e4-34853a77d07b'}}} Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3d4ff192-25cf-4745-91e4-34853a77d07b is already attached to instances: 65181ed7-9c92-40b3-b38e-42adcd8d2f20 Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:41.528177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3d4ff192-25cf-4745-91e4-34853a77d07b is already attached to instances: 65181ed7-9c92-40b3-b38e-42adcd8d2f20 Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:41.530173 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:41.532219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:41.532219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:00:41.532219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:00:41.532219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3d4ff192-25cf-4745-91e4-34853a77d07b is already attached to instances: 65181ed7-9c92-40b3-b38e-42adcd8d2f20 Jul 18 17:00:41.532219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:41.532219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 400 to user: Invalid volume: volume 3d4ff192-25cf-4745-91e4-34853a77d07b is already attached to instances: 65181ed7-9c92-40b3-b38e-42adcd8d2f20 {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:00:41.532219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-001f84a6-07ec-4464-8b96-c7edf7ea1c0c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127788 Jul 18 17:00:41.532219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 483/981] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 17:00:41 2022] POST /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments => generated 174 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:00:41.537041 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5b8120b6-4283-4f6b-bba8-61551c591363 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.202395 Jul 18 17:00:41.538148 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 499/982] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:41 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:41.604602 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-00079f0a-355a-4e48-bd47-fbf12b9c18ff tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:41.605128 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-00079f0a-355a-4e48-bd47-fbf12b9c18ff tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:41.611515 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00079f0a-355a-4e48-bd47-fbf12b9c18ff tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:41.612000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00079f0a-355a-4e48-bd47-fbf12b9c18ff tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:41.612781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00079f0a-355a-4e48-bd47-fbf12b9c18ff tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:41.613253 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00079f0a-355a-4e48-bd47-fbf12b9c18ff tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:41.706793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-00079f0a-355a-4e48-bd47-fbf12b9c18ff tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lazy-loading 'services' on Instance uuid 65181ed7-9c92-40b3-b38e-42adcd8d2f20 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:00:42.009390 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-00079f0a-355a-4e48-bd47-fbf12b9c18ff tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments/3d4ff192-25cf-4745-91e4-34853a77d07b" status: 202 len: 0 microversion: 2.1 time: 0.408777 Jul 18 17:00:42.010745 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 484/983] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 17:00:41 2022] DELETE /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments/3d4ff192-25cf-4745-91e4-34853a77d07b => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:00:42.020261 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-88db5d1b-40bb-4e1f-bfd8-725a8eafa812 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:42.021858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-88db5d1b-40bb-4e1f-bfd8-725a8eafa812 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:42.028769 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-88db5d1b-40bb-4e1f-bfd8-725a8eafa812 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:42.029580 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-88db5d1b-40bb-4e1f-bfd8-725a8eafa812 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:42.031301 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-88db5d1b-40bb-4e1f-bfd8-725a8eafa812 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:42.032213 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-88db5d1b-40bb-4e1f-bfd8-725a8eafa812 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:42.230055 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-88db5d1b-40bb-4e1f-bfd8-725a8eafa812 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214403 Jul 18 17:00:42.234530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 500/984] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 17:00:42 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:42.555951 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:42.556623 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:42.563998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:42.564448 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:42.565254 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:42.565895 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:42.722484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:42.736894 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:42.741887 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:42.743203 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b02c9732-cecc-4146-9dde-9acbbe26d3b0 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.191593 Jul 18 17:00:42.744131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 485/985] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:42 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:43.241745 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cc75703c-7ad5-4f94-8984-fa343ab52635 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:43.242722 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cc75703c-7ad5-4f94-8984-fa343ab52635 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:43.250114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc75703c-7ad5-4f94-8984-fa343ab52635 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:43.250597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc75703c-7ad5-4f94-8984-fa343ab52635 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:43.251378 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc75703c-7ad5-4f94-8984-fa343ab52635 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:43.251817 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc75703c-7ad5-4f94-8984-fa343ab52635 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:43.255943 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:43.282703 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cc75703c-7ad5-4f94-8984-fa343ab52635 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Jul 18 17:00:43.450858 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 501/986] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 17:00:43 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:43.762195 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:43.763432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:43.770469 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:43.771130 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:43.772345 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:43.773045 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:43.943080 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:43.952840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:43.954475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:43.955661 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-317042eb-5546-41cc-961f-8607d2e97015 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.197698 Jul 18 17:00:43.956490 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 486/987] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:43 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:44.294670 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-eeec237b-f386-4e2e-84a6-467f009f02d1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:44.295764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-eeec237b-f386-4e2e-84a6-467f009f02d1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:44.303136 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eeec237b-f386-4e2e-84a6-467f009f02d1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:44.303687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eeec237b-f386-4e2e-84a6-467f009f02d1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:44.304531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eeec237b-f386-4e2e-84a6-467f009f02d1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:44.305423 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-eeec237b-f386-4e2e-84a6-467f009f02d1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:44.344848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-eeec237b-f386-4e2e-84a6-467f009f02d1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053914 Jul 18 17:00:44.345825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 502/988] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 17:00:44 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 17:00:44.409202 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-54d255b1-f29a-45d1-bcae-e0b018349288 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:44.409612 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-54d255b1-f29a-45d1-bcae-e0b018349288 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:44.415780 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54d255b1-f29a-45d1-bcae-e0b018349288 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:44.416240 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54d255b1-f29a-45d1-bcae-e0b018349288 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:44.417677 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54d255b1-f29a-45d1-bcae-e0b018349288 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:44.418125 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-54d255b1-f29a-45d1-bcae-e0b018349288 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:44.426199 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:44.451842 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-54d255b1-f29a-45d1-bcae-e0b018349288 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:00:44.820230 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-54d255b1-f29a-45d1-bcae-e0b018349288 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 204 len: 0 microversion: 2.1 time: 0.415344 Jul 18 17:00:44.820982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 487/989] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:00:44 2022] DELETE /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:00:44.830933 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9556349a-b922-4126-b28a-eec74ab9557c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:44.831587 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9556349a-b922-4126-b28a-eec74ab9557c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:44.838711 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9556349a-b922-4126-b28a-eec74ab9557c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:44.839384 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9556349a-b922-4126-b28a-eec74ab9557c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:44.840200 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9556349a-b922-4126-b28a-eec74ab9557c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:44.840647 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9556349a-b922-4126-b28a-eec74ab9557c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:44.974661 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:44.975762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:44.983867 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:44.984488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:44.985681 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:44.986196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:45.002026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9556349a-b922-4126-b28a-eec74ab9557c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:45.010360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9556349a-b922-4126-b28a-eec74ab9557c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1681 microversion: 2.1 time: 0.184831 Jul 18 17:00:45.011303 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 503/990] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:44 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:45.151470 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:45.153110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:45.155392 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:45.156772 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-87171fff-10e8-45d9-b4da-b8320908982f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.186418 Jul 18 17:00:45.157686 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 488/991] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:44 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:00:46.031336 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-806f5a7f-3608-487c-b788-dde0fa7a62ec tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:46.032108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-806f5a7f-3608-487c-b788-dde0fa7a62ec tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:46.042941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-806f5a7f-3608-487c-b788-dde0fa7a62ec tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:46.043400 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-806f5a7f-3608-487c-b788-dde0fa7a62ec tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:46.044190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-806f5a7f-3608-487c-b788-dde0fa7a62ec tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:46.045260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-806f5a7f-3608-487c-b788-dde0fa7a62ec tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:46.175851 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:46.176474 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:46.179970 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:46.184562 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:46.184957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:46.186354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:46.186792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:46.200113 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-806f5a7f-3608-487c-b788-dde0fa7a62ec tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:46.210566 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-806f5a7f-3608-487c-b788-dde0fa7a62ec tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1681 microversion: 2.1 time: 0.185665 Jul 18 17:00:46.222515 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 504/992] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:46 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:46.337901 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:46.346204 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:46.348658 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:46.349883 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3117a448-0e1f-498e-8385-37840245411e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.178494 Jul 18 17:00:46.350472 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 489/993] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:46 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:00:47.229994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7857b7ac-bdd1-4c6c-8c9a-452e86ca7734 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:47.230596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7857b7ac-bdd1-4c6c-8c9a-452e86ca7734 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:47.240464 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7857b7ac-bdd1-4c6c-8c9a-452e86ca7734 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:47.241328 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7857b7ac-bdd1-4c6c-8c9a-452e86ca7734 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:47.243209 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7857b7ac-bdd1-4c6c-8c9a-452e86ca7734 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:47.243209 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7857b7ac-bdd1-4c6c-8c9a-452e86ca7734 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:47.371279 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:47.371935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:47.379398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:47.381063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:47.381063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:47.381266 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:47.392738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7857b7ac-bdd1-4c6c-8c9a-452e86ca7734 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:47.407153 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7857b7ac-bdd1-4c6c-8c9a-452e86ca7734 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1681 microversion: 2.1 time: 0.180800 Jul 18 17:00:47.411614 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 505/994] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:47 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:47.642486 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:47.650553 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:47.652161 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:47.653327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-852eb81f-7f08-441f-a12f-7e30c102174c tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1737 microversion: 2.20 time: 0.286293 Jul 18 17:00:47.653894 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 490/995] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:47 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1737 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:00:48.095269 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-2236d520-555a-4b93-a1f3-421074fe68c3 req-a19e26b7-d6a6-4b65-92e0-88ac907cfd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65181ed7-9c92-40b3-b38e-42adcd8d2f20", "name": "network-vif-deleted", "tag": "995c2cb3-155c-4c29-bdf4-05a9d26eac6f"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:48.103525 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-2236d520-555a-4b93-a1f3-421074fe68c3 req-a19e26b7-d6a6-4b65-92e0-88ac907cfd22 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.103982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-2236d520-555a-4b93-a1f3-421074fe68c3 req-a19e26b7-d6a6-4b65-92e0-88ac907cfd22 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.117208 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-2236d520-555a-4b93-a1f3-421074fe68c3 req-a19e26b7-d6a6-4b65-92e0-88ac907cfd22 service nova] Creating event network-vif-deleted:995c2cb3-155c-4c29-bdf4-05a9d26eac6f for instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 on hv-cinder-84617 Jul 18 17:00:48.122211 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-2236d520-555a-4b93-a1f3-421074fe68c3 req-a19e26b7-d6a6-4b65-92e0-88ac907cfd22 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031281 Jul 18 17:00:48.122905 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 506/996] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:48.426115 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ea118957-85fa-4c37-8248-6b0f87900045 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:48.426749 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ea118957-85fa-4c37-8248-6b0f87900045 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:48.433582 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea118957-85fa-4c37-8248-6b0f87900045 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.434031 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea118957-85fa-4c37-8248-6b0f87900045 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.434806 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea118957-85fa-4c37-8248-6b0f87900045 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.435243 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ea118957-85fa-4c37-8248-6b0f87900045 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.499140 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ea118957-85fa-4c37-8248-6b0f87900045 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:48.506973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ea118957-85fa-4c37-8248-6b0f87900045 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 200 len: 1327 microversion: 2.1 time: 0.084786 Jul 18 17:00:48.507655 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 491/997] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:48 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 1327 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:48.683917 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:48.684657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:48.686736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=39 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:48.692689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.693423 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.694218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:48.694660 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:48.864507 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:48.873830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:48.875407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:48.876575 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c9bd5ed8-51c6-46b3-bdc4-f72cc901aa79 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1719 microversion: 2.20 time: 0.208644 Jul 18 17:00:48.877181 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 507/998] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:48 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:49.524799 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:49.525454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:49.531983 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:49.532446 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:49.533235 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:49.533670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:49.547382 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 HTTP/1.1 Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:00:49.549072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:00:49.550880 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '65181ed7-9c92-40b3-b38e-42adcd8d2f20'} Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:00:49.551705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:00:49.558592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:00:49.560021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:00:49.560021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-bc9957ff-5501-4cfa-8db0-7842279952fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 404 len: 111 microversion: 2.1 time: 0.029667 Jul 18 17:00:49.560021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 492/999] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:49 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:00:49.565689 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bd4bea9f-6ee1-4204-881d-c23777ee9015 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '.version_select at 0x7fd4f50fc280>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:49.632444 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bd4bea9f-6ee1-4204-881d-c23777ee9015 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513639572" status: 202 len: 0 microversion: 2.1 time: 0.070510 Jul 18 17:00:49.633048 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 508/1000] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 18 17:00:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513639572 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:00:49.896391 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:49.897056 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:49.916329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:49.916329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:49.916329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:49.916329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:50.179590 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:50.188171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:50.189838 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:50.191061 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-07b8c6d3-07ab-4c0f-ac02-b489457db039 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1719 microversion: 2.20 time: 0.299838 Jul 18 17:00:50.191712 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 493/1001] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:49 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1719 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:50.524372 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cc3dc009-fff2-4066-ac84-aa045651dece tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: .version_select at 0x7fd4f9b04af0>, body: {"keypair": {"name": "tempest-keypair-21523698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqPuAoi1vLJV/uBMQdYzVMOAJw6h0MGCN241U4bVwI9u1aYrRzW65CMZGpKKRD3o/jDrwJMpzUsrPsG210/XWLUGnT2mwWvpDHYYZ7hzls7+2mK6rpNCGLH+/lXXSuUSg=="}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:50.538572 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-cc3dc009-fff2-4066-ac84-aa045651dece tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for project 25de8ee0667645a3864d846675d460e1. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:00:50.542391 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-cc3dc009-fff2-4066-ac84-aa045651dece tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for user 730d6426b4ee4cf38893fe2e60b97230 and project 25de8ee0667645a3864d846675d460e1. Resources: {'key_pairs'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:00:50.628219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cc3dc009-fff2-4066-ac84-aa045651dece tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.108176 Jul 18 17:00:50.628832 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 509/1002] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 18 17:00:50 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:50.985602 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-4be26864-bed7-4aee-b56f-b78be26ffc0a req-94adc2c9-8fad-440a-8bac-be00399020ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920250a7-2997-49fb-9430-de226b904c0d", "name": "network-vif-unplugged", "status": "completed", "tag": "03d2b05e-f777-497c-a943-ec3d77aa90a3"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:50.994730 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-4be26864-bed7-4aee-b56f-b78be26ffc0a req-94adc2c9-8fad-440a-8bac-be00399020ed service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:50.995177 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-4be26864-bed7-4aee-b56f-b78be26ffc0a req-94adc2c9-8fad-440a-8bac-be00399020ed service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:51.006121 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-4be26864-bed7-4aee-b56f-b78be26ffc0a req-94adc2c9-8fad-440a-8bac-be00399020ed service nova] Creating event network-vif-unplugged:03d2b05e-f777-497c-a943-ec3d77aa90a3 for instance 920250a7-2997-49fb-9430-de226b904c0d on hv-cinder-84617 Jul 18 17:00:51.010940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-4be26864-bed7-4aee-b56f-b78be26ffc0a req-94adc2c9-8fad-440a-8bac-be00399020ed service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029772 Jul 18 17:00:51.011566 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 494/1003] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:51.209881 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:51.210488 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:51.217459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:51.218114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:51.219021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:51.219464 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:51.360255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:51.368184 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:51.369706 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:51.370906 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-3ea0850e-7b9c-4646-b28c-22d7f83ddf20 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1719 microversion: 2.20 time: 0.164920 Jul 18 17:00:51.371386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 510/1004] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:51 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:52.390289 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:52.390910 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:52.397211 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.397644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.398405 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.398836 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.555201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:52.563762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:52.565282 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:52.566421 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-82211ae6-13f6-4c01-ac49-70d8d57b9fcf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1662 microversion: 2.20 time: 0.181198 Jul 18 17:00:52.566969 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 495/1005] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:52 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1662 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:52.584900 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b0f119d4-03dc-4598-910d-388b0ed4233f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5085809e-a3a6-47b6-9902-41202dbe0d5f"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:52.585974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b0f119d4-03dc-4598-910d-388b0ed4233f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:52.592612 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b0f119d4-03dc-4598-910d-388b0ed4233f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.593124 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b0f119d4-03dc-4598-910d-388b0ed4233f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.593903 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b0f119d4-03dc-4598-910d-388b0ed4233f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:52.594344 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b0f119d4-03dc-4598-910d-388b0ed4233f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:52.817601 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1332451667", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9ef866c-b807-4e8d-a4b6-a34e3d904b55"}], "security_groups": [{"name": "tempest-securitygroup--995953200"}], "key_name": "tempest-keypair-21523698", "user_data": "}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:52.918611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] validate_networks() for [('a9ef866c-b807-4e8d-a4b6-a34e3d904b55', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:00:53.312840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:00:53.312840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:00:53.312840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:00:53.312840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:00:53.313345 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:00:53.322273 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:53.322711 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:53.323728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:53.324131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:53.341095 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for project 25de8ee0667645a3864d846675d460e1. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:00:53.345643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Getting quotas for user 730d6426b4ee4cf38893fe2e60b97230 and project 25de8ee0667645a3864d846675d460e1. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:00:53.356605 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:00:53.358890 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:00:53.438201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b0f119d4-03dc-4598-910d-388b0ed4233f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.857318 Jul 18 17:00:53.438822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 511/1006] 10.222.0.88 () {62 vars in 1363 bytes} [Mon Jul 18 17:00:52 2022] POST /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/os-volume_attachments => generated 188 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 17:00:53.510548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-43e09805-2d46-4e8e-8ef5-4b8c181b6a01 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.697631 Jul 18 17:00:53.512031 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 496/1007] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 17:00:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 17:00:53.522364 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-45bdfe38-a735-4b06-891e-9047c5a03804 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:53.523158 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-45bdfe38-a735-4b06-891e-9047c5a03804 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:53.571680 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f8c534e8-3baf-4581-b658-9ec110c267ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:53.572400 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f8c534e8-3baf-4581-b658-9ec110c267ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:53.580227 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f8c534e8-3baf-4581-b658-9ec110c267ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:53.580781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f8c534e8-3baf-4581-b658-9ec110c267ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:53.581594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-45bdfe38-a735-4b06-891e-9047c5a03804 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:53.581821 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f8c534e8-3baf-4581-b658-9ec110c267ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:53.582405 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f8c534e8-3baf-4581-b658-9ec110c267ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:53.588402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-45bdfe38-a735-4b06-891e-9047c5a03804 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1240 microversion: 2.1 time: 0.069959 Jul 18 17:00:53.592267 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 512/1008] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:53 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:54.237659 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f8c534e8-3baf-4581-b658-9ec110c267ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/os-volume_attachments/5085809e-a3a6-47b6-9902-41202dbe0d5f" status: 202 len: 0 microversion: 2.20 time: 0.670267 Jul 18 17:00:54.238276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 497/1009] 10.222.0.88 () {60 vars in 1456 bytes} [Mon Jul 18 17:00:53 2022] DELETE /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/os-volume_attachments/5085809e-a3a6-47b6-9902-41202dbe0d5f => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:00:54.294672 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7709529d-0aad-4714-a8a0-3a9e0456e32f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:54.295243 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7709529d-0aad-4714-a8a0-3a9e0456e32f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:54.302100 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7709529d-0aad-4714-a8a0-3a9e0456e32f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.302556 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7709529d-0aad-4714-a8a0-3a9e0456e32f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.303330 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7709529d-0aad-4714-a8a0-3a9e0456e32f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.303830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7709529d-0aad-4714-a8a0-3a9e0456e32f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.520632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7709529d-0aad-4714-a8a0-3a9e0456e32f tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "POST /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/action" status: 202 len: 0 microversion: 2.20 time: 0.230031 Jul 18 17:00:54.521487 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 513/1010] 10.222.0.88 () {62 vars in 1318 bytes} [Mon Jul 18 17:00:54 2022] POST /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:00:54.529327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:54.529978 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:54.537960 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.538512 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.539292 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.539753 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.606735 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f2e27a56-0b1b-42fc-a1c6-9d722ffe88e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:54.607433 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f2e27a56-0b1b-42fc-a1c6-9d722ffe88e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:54.614003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f2e27a56-0b1b-42fc-a1c6-9d722ffe88e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.614557 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f2e27a56-0b1b-42fc-a1c6-9d722ffe88e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.615420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f2e27a56-0b1b-42fc-a1c6-9d722ffe88e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:54.616085 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f2e27a56-0b1b-42fc-a1c6-9d722ffe88e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:54.684302 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f2e27a56-0b1b-42fc-a1c6-9d722ffe88e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:54.697026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f2e27a56-0b1b-42fc-a1c6-9d722ffe88e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1244 microversion: 2.1 time: 0.090379 Jul 18 17:00:54.697026 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 514/1011] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:54 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:54.697262 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:54.702794 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:54.704289 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:54.705475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6f5c5b25-db49-4d48-af57-c100acad9b0e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1670 microversion: 2.20 time: 0.180063 Jul 18 17:00:54.706034 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 498/1012] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:54 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:55.710472 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-908a1407-f116-4b71-924e-91d99cf0e9fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:55.711060 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-908a1407-f116-4b71-924e-91d99cf0e9fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:55.717727 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-908a1407-f116-4b71-924e-91d99cf0e9fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:55.724414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:55.725297 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:55.727863 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-908a1407-f116-4b71-924e-91d99cf0e9fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:55.728781 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-908a1407-f116-4b71-924e-91d99cf0e9fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:55.729249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-908a1407-f116-4b71-924e-91d99cf0e9fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:55.740825 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:55.741300 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:55.742073 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:55.742502 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:55.813683 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-908a1407-f116-4b71-924e-91d99cf0e9fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:55.821833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-908a1407-f116-4b71-924e-91d99cf0e9fd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1300 microversion: 2.1 time: 0.115230 Jul 18 17:00:55.822427 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 515/1013] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:55 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:55.914812 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:55.923559 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:55.924420 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:55.925624 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c4338074-0b5f-42fb-8c8e-ccdcf40fb09e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1672 microversion: 2.20 time: 0.206024 Jul 18 17:00:55.927274 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 499/1014] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:55 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1672 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:56.839137 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-11c25b87-c2f4-42d9-bd8a-4da9378527a1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:56.839853 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-11c25b87-c2f4-42d9-bd8a-4da9378527a1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:56.847488 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-11c25b87-c2f4-42d9-bd8a-4da9378527a1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:56.847956 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-11c25b87-c2f4-42d9-bd8a-4da9378527a1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:56.848747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-11c25b87-c2f4-42d9-bd8a-4da9378527a1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:56.849293 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-11c25b87-c2f4-42d9-bd8a-4da9378527a1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:56.945140 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:56.947000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:56.955713 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:56.956171 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:56.957215 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:56.957560 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:56.995707 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-11c25b87-c2f4-42d9-bd8a-4da9378527a1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:57.003360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-11c25b87-c2f4-42d9-bd8a-4da9378527a1 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.168122 Jul 18 17:00:57.003923 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 516/1015] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:56 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:57.281922 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:57.291308 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:57.293162 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:57.302414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-00199cf7-af4e-406e-9ed4-f7cf8e5b9645 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.353643 Jul 18 17:00:57.302414 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 500/1016] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:56 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:00:58.028240 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ef7a6581-e64c-49bc-a368-def2efa9b5bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:58.030833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ef7a6581-e64c-49bc-a368-def2efa9b5bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:58.038439 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef7a6581-e64c-49bc-a368-def2efa9b5bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.062130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef7a6581-e64c-49bc-a368-def2efa9b5bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.063014 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef7a6581-e64c-49bc-a368-def2efa9b5bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.063522 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef7a6581-e64c-49bc-a368-def2efa9b5bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.132276 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-0aabe4ba-5b72-40a8-a4a4-56d17138b9af req-cd277630-f413-4d99-9310-889f7d636628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008f8524-193f-493a-81b0-9d55d0a0e838", "tag": "d72bc6fa-f304-455b-8dad-10c18eac6323"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:00:58.143399 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-0aabe4ba-5b72-40a8-a4a4-56d17138b9af req-cd277630-f413-4d99-9310-889f7d636628 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.143850 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-0aabe4ba-5b72-40a8-a4a4-56d17138b9af req-cd277630-f413-4d99-9310-889f7d636628 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.160161 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-0aabe4ba-5b72-40a8-a4a4-56d17138b9af req-cd277630-f413-4d99-9310-889f7d636628 service nova] Creating event network-changed:d72bc6fa-f304-455b-8dad-10c18eac6323 for instance 008f8524-193f-493a-81b0-9d55d0a0e838 on hv-cinder-84617 Jul 18 17:00:58.165849 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-0aabe4ba-5b72-40a8-a4a4-56d17138b9af req-cd277630-f413-4d99-9310-889f7d636628 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124684 Jul 18 17:00:58.166737 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 501/1017] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:58.253393 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ef7a6581-e64c-49bc-a368-def2efa9b5bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:58.259130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:58.261751 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ef7a6581-e64c-49bc-a368-def2efa9b5bb tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.241272 Jul 18 17:00:58.262349 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 517/1018] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:58 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:58.316415 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:58.317342 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:58.323954 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.324405 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.325237 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:58.325672 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:58.341727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:58.604544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:58.624860 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:58.627063 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:58.628724 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-21b019d3-7435-401f-a354-8772c03e39cb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.316669 Jul 18 17:00:58.629883 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 502/1019] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:58 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:00:59.281308 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d6619a7f-5b15-405e-b382-a213506c1ec0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:59.282774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d6619a7f-5b15-405e-b382-a213506c1ec0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:59.290624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d6619a7f-5b15-405e-b382-a213506c1ec0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:59.291352 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d6619a7f-5b15-405e-b382-a213506c1ec0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:59.292083 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d6619a7f-5b15-405e-b382-a213506c1ec0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:59.292620 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d6619a7f-5b15-405e-b382-a213506c1ec0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:59.461978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-d6619a7f-5b15-405e-b382-a213506c1ec0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:59.470359 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d6619a7f-5b15-405e-b382-a213506c1ec0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.194734 Jul 18 17:00:59.470940 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 518/1020] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:59 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:59.648219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:59.649133 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:59.656621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:59.657168 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:59.658367 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:59.658861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:59.804577 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:59.814996 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:59.816567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:59.818053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-962c163a-c404-4fba-a973-1e44a596ccc3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.174349 Jul 18 17:00:59.819855 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 503/1021] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:00:59 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:00.486982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-78409bbd-6054-460a-8292-e47766c1c8cf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:00.487678 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-78409bbd-6054-460a-8292-e47766c1c8cf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:00.494482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-78409bbd-6054-460a-8292-e47766c1c8cf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.494930 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-78409bbd-6054-460a-8292-e47766c1c8cf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.495706 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-78409bbd-6054-460a-8292-e47766c1c8cf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.496148 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-78409bbd-6054-460a-8292-e47766c1c8cf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.637509 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-78409bbd-6054-460a-8292-e47766c1c8cf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:00.646058 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-78409bbd-6054-460a-8292-e47766c1c8cf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.162915 Jul 18 17:01:00.647174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 519/1022] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:00 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:00.837607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:00.838214 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:00.845626 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.846072 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.846845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:00.847282 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:00.998352 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:01.008162 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:01.009766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:01.010940 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8a50390f-0a00-4c42-a1ff-cfc8a32bf30b tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.178571 Jul 18 17:01:01.011500 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 504/1023] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:00 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:01.664237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-abb1332d-6b5c-455f-ba76-7f4d8ba82940 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:01.664955 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-abb1332d-6b5c-455f-ba76-7f4d8ba82940 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:01.671953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-abb1332d-6b5c-455f-ba76-7f4d8ba82940 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:01.672405 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-abb1332d-6b5c-455f-ba76-7f4d8ba82940 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:01.673211 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-abb1332d-6b5c-455f-ba76-7f4d8ba82940 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:01.673645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-abb1332d-6b5c-455f-ba76-7f4d8ba82940 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:01.820491 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-abb1332d-6b5c-455f-ba76-7f4d8ba82940 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:01.829253 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-abb1332d-6b5c-455f-ba76-7f4d8ba82940 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.169194 Jul 18 17:01:01.829854 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 520/1024] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:01 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:02.029012 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:02.029639 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:02.037885 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:02.038715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:02.039435 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:02.040196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:02.185529 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:02.194964 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:02.196445 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:02.197986 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-05918083-8033-494e-8daa-d87efdb8d5f7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.172930 Jul 18 17:01:02.198540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 505/1025] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:02 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:02.847417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0dc54b90-bb89-4964-a37d-e49efa644aa0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:02.848121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0dc54b90-bb89-4964-a37d-e49efa644aa0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:02.854502 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0dc54b90-bb89-4964-a37d-e49efa644aa0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:02.854958 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0dc54b90-bb89-4964-a37d-e49efa644aa0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:02.855736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0dc54b90-bb89-4964-a37d-e49efa644aa0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:02.856173 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0dc54b90-bb89-4964-a37d-e49efa644aa0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:03.008368 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0dc54b90-bb89-4964-a37d-e49efa644aa0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:03.016593 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0dc54b90-bb89-4964-a37d-e49efa644aa0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.172993 Jul 18 17:01:03.018924 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 521/1026] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:02 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:03.217829 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:03.219200 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:03.226045 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:03.226498 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:03.227283 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:03.227727 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:03.332123 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:03.351883 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=6 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:03.374683 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:03.386503 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:03.387983 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:03.401265 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c08f3569-60cc-412a-a064-c441d1c20f1e tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.175487 Jul 18 17:01:03.401927 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 506/1027] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:03 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:04.032846 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f7b18fb8-a342-4a39-a072-a8b2b64fcdbd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:04.039032 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f7b18fb8-a342-4a39-a072-a8b2b64fcdbd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:04.039032 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=6 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:04.041763 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7b18fb8-a342-4a39-a072-a8b2b64fcdbd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:04.042297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7b18fb8-a342-4a39-a072-a8b2b64fcdbd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:04.043067 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7b18fb8-a342-4a39-a072-a8b2b64fcdbd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:04.043507 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7b18fb8-a342-4a39-a072-a8b2b64fcdbd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:04.187846 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f7b18fb8-a342-4a39-a072-a8b2b64fcdbd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:04.196397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f7b18fb8-a342-4a39-a072-a8b2b64fcdbd tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.167319 Jul 18 17:01:04.197045 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 522/1028] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:04 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:04.419751 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:04.421331 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:04.431281 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:04.431726 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:04.432507 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:04.432974 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:04.588707 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:04.597646 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:04.599156 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:04.600391 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a2d68e66-58f9-43fb-8f03-999c8b1fe6ed tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.184555 Jul 18 17:01:04.601000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 507/1029] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:04 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:05.218735 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c0805307-b993-472c-a18d-008d73b70ed0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:05.220662 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c0805307-b993-472c-a18d-008d73b70ed0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:05.232306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c0805307-b993-472c-a18d-008d73b70ed0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.233459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c0805307-b993-472c-a18d-008d73b70ed0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.234436 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c0805307-b993-472c-a18d-008d73b70ed0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.234940 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c0805307-b993-472c-a18d-008d73b70ed0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.387623 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c0805307-b993-472c-a18d-008d73b70ed0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.397048 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c0805307-b993-472c-a18d-008d73b70ed0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.185586 Jul 18 17:01:05.397683 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 523/1030] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:05 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:05.621424 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:05.623153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:05.631654 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.632909 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.633073 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:05.633544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:05.783654 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.794352 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.796534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:05.797979 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-7597b2ff-1c79-4dcf-b242-0faffd85e796 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.182298 Jul 18 17:01:05.798644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 508/1031] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:05 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:06.417488 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-dbfe0929-5e97-4a64-996f-f9a34968b540 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:06.418094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-dbfe0929-5e97-4a64-996f-f9a34968b540 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:06.425140 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dbfe0929-5e97-4a64-996f-f9a34968b540 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.429328 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dbfe0929-5e97-4a64-996f-f9a34968b540 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.429328 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dbfe0929-5e97-4a64-996f-f9a34968b540 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.429328 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dbfe0929-5e97-4a64-996f-f9a34968b540 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.582399 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-dbfe0929-5e97-4a64-996f-f9a34968b540 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:06.587288 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-dbfe0929-5e97-4a64-996f-f9a34968b540 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.173705 Jul 18 17:01:06.588129 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 524/1032] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:06 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:06.815657 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:06.816402 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:06.823232 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.823690 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:06.824497 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:06.824959 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:07.042598 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.053721 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.057466 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.058788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b7b23872-d815-4f5f-963f-0a24aeee9b80 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.247123 Jul 18 17:01:07.059339 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 509/1033] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:06 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:07.604820 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2210c744-a429-4cc8-800b-38c8d5fc55f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:07.605530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2210c744-a429-4cc8-800b-38c8d5fc55f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:07.612714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2210c744-a429-4cc8-800b-38c8d5fc55f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:07.613518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2210c744-a429-4cc8-800b-38c8d5fc55f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:07.614333 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2210c744-a429-4cc8-800b-38c8d5fc55f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:07.614775 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2210c744-a429-4cc8-800b-38c8d5fc55f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:07.753896 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-2210c744-a429-4cc8-800b-38c8d5fc55f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:07.761360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2210c744-a429-4cc8-800b-38c8d5fc55f6 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.160634 Jul 18 17:01:07.765533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 525/1034] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:07 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:08.078271 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:08.078931 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:08.085716 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.086169 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.087131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.087581 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.223756 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:08.232284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:08.233922 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:08.235126 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-73a142f7-bb7a-4acb-bfe3-36913722a0cf tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.161550 Jul 18 17:01:08.235705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 510/1035] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:08 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:08.778764 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-57fb1c63-0f74-4b22-811b-5bc6bc572e27 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:08.780090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-57fb1c63-0f74-4b22-811b-5bc6bc572e27 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:08.786655 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-57fb1c63-0f74-4b22-811b-5bc6bc572e27 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.788284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-57fb1c63-0f74-4b22-811b-5bc6bc572e27 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.788284 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-57fb1c63-0f74-4b22-811b-5bc6bc572e27 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:08.788511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-57fb1c63-0f74-4b22-811b-5bc6bc572e27 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:08.918397 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-57fb1c63-0f74-4b22-811b-5bc6bc572e27 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:08.926808 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-57fb1c63-0f74-4b22-811b-5bc6bc572e27 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.151813 Jul 18 17:01:08.927347 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 526/1036] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:08 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:09.254020 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:09.254619 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:09.261078 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.261528 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:09.262277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.262706 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:09.395006 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:09.402973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:09.405091 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:09.406302 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1a748b56-1274-4e53-b1a8-31f99d4bcbe4 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.156269 Jul 18 17:01:09.406889 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 511/1037] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:09 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:09.944130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-270e29ab-9e26-4d98-9532-cf6379bee406 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:09.944774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-270e29ab-9e26-4d98-9532-cf6379bee406 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:09.951549 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-270e29ab-9e26-4d98-9532-cf6379bee406 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.951997 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-270e29ab-9e26-4d98-9532-cf6379bee406 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:09.952763 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-270e29ab-9e26-4d98-9532-cf6379bee406 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:09.953319 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-270e29ab-9e26-4d98-9532-cf6379bee406 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.085596 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-270e29ab-9e26-4d98-9532-cf6379bee406 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.093613 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-270e29ab-9e26-4d98-9532-cf6379bee406 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.153636 Jul 18 17:01:10.094179 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 527/1038] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:09 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:10.424784 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:10.425462 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:10.432083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.432537 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.433349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:10.433800 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:10.571339 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.580084 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.581599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:10.583512 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f3da1d7f-7578-4ec0-b7a0-f52740c461a3 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.162543 Jul 18 17:01:10.584092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 512/1039] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:10 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:11.111332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4b2dddf1-4f0c-48a1-8310-bfa23d831b65 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:11.111945 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4b2dddf1-4f0c-48a1-8310-bfa23d831b65 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:11.118482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4b2dddf1-4f0c-48a1-8310-bfa23d831b65 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.118933 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4b2dddf1-4f0c-48a1-8310-bfa23d831b65 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.119701 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4b2dddf1-4f0c-48a1-8310-bfa23d831b65 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.120137 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4b2dddf1-4f0c-48a1-8310-bfa23d831b65 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.257489 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4b2dddf1-4f0c-48a1-8310-bfa23d831b65 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.265015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4b2dddf1-4f0c-48a1-8310-bfa23d831b65 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.157510 Jul 18 17:01:11.265680 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 528/1040] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:11 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:11.601353 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:11.601960 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:11.609151 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.609894 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.610635 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:11.611064 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:11.745304 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.753220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.754803 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:11.755885 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-86649dd8-1272-4075-89a4-acc70b0256a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.158509 Jul 18 17:01:11.756450 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 513/1041] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:11 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:01:12.282733 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0a9625b0-400a-44c6-b8e7-9dc4b9b2de7c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:12.283387 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0a9625b0-400a-44c6-b8e7-9dc4b9b2de7c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:12.290219 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0a9625b0-400a-44c6-b8e7-9dc4b9b2de7c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.290673 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0a9625b0-400a-44c6-b8e7-9dc4b9b2de7c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.294502 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0a9625b0-400a-44c6-b8e7-9dc4b9b2de7c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.294502 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0a9625b0-400a-44c6-b8e7-9dc4b9b2de7c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.445265 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0a9625b0-400a-44c6-b8e7-9dc4b9b2de7c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.453299 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0a9625b0-400a-44c6-b8e7-9dc4b9b2de7c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.175206 Jul 18 17:01:12.453856 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 529/1042] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:12 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:12.774567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:12.775323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:12.783021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.783497 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.784273 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:12.784705 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:12.918402 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.926946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.928444 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:12.929656 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-48289451-5138-4a0e-8400-afc9642f54c1 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.159263 Jul 18 17:01:12.930238 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 514/1043] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:12 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:13.470884 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c1684885-57a6-449e-bcfb-8d62ce6d052e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:13.471575 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c1684885-57a6-449e-bcfb-8d62ce6d052e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:13.478094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1684885-57a6-449e-bcfb-8d62ce6d052e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.478551 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1684885-57a6-449e-bcfb-8d62ce6d052e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.479332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1684885-57a6-449e-bcfb-8d62ce6d052e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.479773 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c1684885-57a6-449e-bcfb-8d62ce6d052e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.504419 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-40cc9467-a84a-4f84-b8a6-271b99e69806 req-df9a7e8b-75e6-4238-bc60-2f5210f6d810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920250a7-2997-49fb-9430-de226b904c0d", "name": "network-vif-plugged", "status": "completed", "tag": "03d2b05e-f777-497c-a943-ec3d77aa90a3"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:13.512952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-40cc9467-a84a-4f84-b8a6-271b99e69806 req-df9a7e8b-75e6-4238-bc60-2f5210f6d810 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.514076 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-40cc9467-a84a-4f84-b8a6-271b99e69806 req-df9a7e8b-75e6-4238-bc60-2f5210f6d810 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.526231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-40cc9467-a84a-4f84-b8a6-271b99e69806 req-df9a7e8b-75e6-4238-bc60-2f5210f6d810 service nova] Creating event network-vif-plugged:03d2b05e-f777-497c-a943-ec3d77aa90a3 for instance 920250a7-2997-49fb-9430-de226b904c0d on hv-cinder-84617 Jul 18 17:01:13.532217 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-40cc9467-a84a-4f84-b8a6-271b99e69806 req-df9a7e8b-75e6-4238-bc60-2f5210f6d810 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Jul 18 17:01:13.532966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 515/1044] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:13.617954 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c1684885-57a6-449e-bcfb-8d62ce6d052e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:13.626411 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c1684885-57a6-449e-bcfb-8d62ce6d052e tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.160095 Jul 18 17:01:13.627000 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 530/1045] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:13 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:13.948872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:13.949754 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:13.957249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.961376 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:13.961376 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:13.961376 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:14.100335 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.108973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.110459 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.111596 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e761994b-0542-4a1f-ad9d-3bf33d703cee tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.167440 Jul 18 17:01:14.112157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 516/1046] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:13 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:14.643379 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-64340e40-8f8d-4b7f-9eea-8b2effc5e12f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:14.644021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-64340e40-8f8d-4b7f-9eea-8b2effc5e12f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:14.651482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-64340e40-8f8d-4b7f-9eea-8b2effc5e12f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:14.651929 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-64340e40-8f8d-4b7f-9eea-8b2effc5e12f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:14.652691 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-64340e40-8f8d-4b7f-9eea-8b2effc5e12f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:14.653160 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-64340e40-8f8d-4b7f-9eea-8b2effc5e12f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:14.781865 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-64340e40-8f8d-4b7f-9eea-8b2effc5e12f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:14.788812 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-64340e40-8f8d-4b7f-9eea-8b2effc5e12f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.149301 Jul 18 17:01:14.789386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 531/1047] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:14 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:15.130126 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:15.130773 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:15.137534 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.137985 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.138851 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.139317 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.276628 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:15.284754 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:15.286350 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:15.287509 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9866c6d0-9d04-4131-975b-f366e58272a5 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.161442 Jul 18 17:01:15.291345 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 517/1048] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:15 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:15.547164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-00c530cb-e203-48e5-92ce-22d0a621d0f1 req-558834bc-60b8-4cca-89e9-59acbf0041b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008f8524-193f-493a-81b0-9d55d0a0e838", "name": "network-vif-plugged", "status": "completed", "tag": "d72bc6fa-f304-455b-8dad-10c18eac6323"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:15.555512 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-00c530cb-e203-48e5-92ce-22d0a621d0f1 req-558834bc-60b8-4cca-89e9-59acbf0041b8 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.555963 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-00c530cb-e203-48e5-92ce-22d0a621d0f1 req-558834bc-60b8-4cca-89e9-59acbf0041b8 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.567469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-00c530cb-e203-48e5-92ce-22d0a621d0f1 req-558834bc-60b8-4cca-89e9-59acbf0041b8 service nova] Creating event network-vif-plugged:d72bc6fa-f304-455b-8dad-10c18eac6323 for instance 008f8524-193f-493a-81b0-9d55d0a0e838 on hv-cinder-84617 Jul 18 17:01:15.572393 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-00c530cb-e203-48e5-92ce-22d0a621d0f1 req-558834bc-60b8-4cca-89e9-59acbf0041b8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029720 Jul 18 17:01:15.573010 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 532/1049] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:15.805528 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-86b6b380-3419-455c-9fb6-6a2755eed52a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:15.806142 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-86b6b380-3419-455c-9fb6-6a2755eed52a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:15.812458 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-86b6b380-3419-455c-9fb6-6a2755eed52a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.812938 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-86b6b380-3419-455c-9fb6-6a2755eed52a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.813737 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-86b6b380-3419-455c-9fb6-6a2755eed52a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:15.814157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-86b6b380-3419-455c-9fb6-6a2755eed52a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:15.983172 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-86b6b380-3419-455c-9fb6-6a2755eed52a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:15.991773 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-86b6b380-3419-455c-9fb6-6a2755eed52a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.189963 Jul 18 17:01:16.001870 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 518/1050] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:15 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:16.307508 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:16.308206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:16.314983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:16.315438 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:16.316200 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:16.316918 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:16.464275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:16.472451 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:16.477332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:16.477332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-10bf9a91-e207-48e4-983c-6abb78a02a72 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1728 microversion: 2.20 time: 0.172545 Jul 18 17:01:16.477332 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 533/1051] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:16 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:17.009441 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6c4d019c-4e97-41bf-9d40-875f7f6af956 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:17.010056 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6c4d019c-4e97-41bf-9d40-875f7f6af956 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:17.012520 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:17.018093 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6c4d019c-4e97-41bf-9d40-875f7f6af956 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:17.018575 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6c4d019c-4e97-41bf-9d40-875f7f6af956 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:17.019556 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6c4d019c-4e97-41bf-9d40-875f7f6af956 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:17.019994 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6c4d019c-4e97-41bf-9d40-875f7f6af956 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:17.152864 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6c4d019c-4e97-41bf-9d40-875f7f6af956 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:17.155249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=100 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:17.161217 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6c4d019c-4e97-41bf-9d40-875f7f6af956 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1365 microversion: 2.1 time: 0.155608 Jul 18 17:01:17.162099 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 519/1052] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:17 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:17.494244 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:17.494878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:17.502084 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:17.502531 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:17.503322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:17.503755 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:17.642022 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:17.650095 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:17.651681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:17.652952 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4a946e36-41c3-4429-b729-b8f50ed1a587 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1715 microversion: 2.20 time: 0.162784 Jul 18 17:01:17.653511 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 534/1053] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:17 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:01:18.179706 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1c3da077-c0f6-4217-b115-c752438f433a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:18.180305 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1c3da077-c0f6-4217-b115-c752438f433a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:18.187961 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1c3da077-c0f6-4217-b115-c752438f433a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:18.188347 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1c3da077-c0f6-4217-b115-c752438f433a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:18.189147 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1c3da077-c0f6-4217-b115-c752438f433a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:18.189591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1c3da077-c0f6-4217-b115-c752438f433a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:18.321419 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1c3da077-c0f6-4217-b115-c752438f433a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:18.330323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1c3da077-c0f6-4217-b115-c752438f433a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1555 microversion: 2.1 time: 0.154823 Jul 18 17:01:18.330906 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 520/1054] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:18 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:18.346518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-dbf3fa93-698d-45d4-9af4-07d89d4d90c8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:18.347039 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-dbf3fa93-698d-45d4-9af4-07d89d4d90c8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:18.353048 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dbf3fa93-698d-45d4-9af4-07d89d4d90c8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:18.353529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dbf3fa93-698d-45d4-9af4-07d89d4d90c8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:18.354288 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dbf3fa93-698d-45d4-9af4-07d89d4d90c8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:18.354753 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dbf3fa93-698d-45d4-9af4-07d89d4d90c8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:18.358469 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=100 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:18.434458 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-dbf3fa93-698d-45d4-9af4-07d89d4d90c8 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091920 Jul 18 17:01:18.435093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 535/1055] 10.222.0.88 () {58 vars in 1274 bytes} [Mon Jul 18 17:01:18 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:19.473808 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-d0da94e0-46a3-4dfb-a3bc-f617248a1861 req-5a64c309-a630-45a3-b038-ad848c0b028a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008f8524-193f-493a-81b0-9d55d0a0e838", "tag": "d72bc6fa-f304-455b-8dad-10c18eac6323"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:19.482539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-d0da94e0-46a3-4dfb-a3bc-f617248a1861 req-5a64c309-a630-45a3-b038-ad848c0b028a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:19.482978 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-d0da94e0-46a3-4dfb-a3bc-f617248a1861 req-5a64c309-a630-45a3-b038-ad848c0b028a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:19.496372 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-d0da94e0-46a3-4dfb-a3bc-f617248a1861 req-5a64c309-a630-45a3-b038-ad848c0b028a service nova] Creating event network-changed:d72bc6fa-f304-455b-8dad-10c18eac6323 for instance 008f8524-193f-493a-81b0-9d55d0a0e838 on hv-cinder-84617 Jul 18 17:01:19.501879 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-d0da94e0-46a3-4dfb-a3bc-f617248a1861 req-5a64c309-a630-45a3-b038-ad848c0b028a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031973 Jul 18 17:01:19.502537 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 521/1056] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:34.096705 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:34.096705 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:34.097432 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=5 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:34.097845 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2adcd135-f0f1-4424-ba1e-7de1a75880f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:34.097942 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=9 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:34.098033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2adcd135-f0f1-4424-ba1e-7de1a75880f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:34.098164 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-91518915-cec1-47f1-90ab-6dbeb4e78dc4 req-4775b138-8df2-46ea-8e31-3b92c6bf7e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff32d36-ec8b-470f-8b36-0f2299cfadd0", "tag": "342742a0-e5ef-4303-9038-522eb8c8e202"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:34.099293 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2adcd135-f0f1-4424-ba1e-7de1a75880f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.099905 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2adcd135-f0f1-4424-ba1e-7de1a75880f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.100533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2adcd135-f0f1-4424-ba1e-7de1a75880f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.101006 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2adcd135-f0f1-4424-ba1e-7de1a75880f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.105407 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-91518915-cec1-47f1-90ab-6dbeb4e78dc4 req-4775b138-8df2-46ea-8e31-3b92c6bf7e10 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.105851 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-91518915-cec1-47f1-90ab-6dbeb4e78dc4 req-4775b138-8df2-46ea-8e31-3b92c6bf7e10 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.117334 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-91518915-cec1-47f1-90ab-6dbeb4e78dc4 req-4775b138-8df2-46ea-8e31-3b92c6bf7e10 service nova] Creating event network-changed:342742a0-e5ef-4303-9038-522eb8c8e202 for instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 on hv-cinder-84617 Jul 18 17:01:34.123589 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-91518915-cec1-47f1-90ab-6dbeb4e78dc4 req-4775b138-8df2-46ea-8e31-3b92c6bf7e10 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033181 Jul 18 17:01:34.124588 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 522/1057] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:34.131132 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2adcd135-f0f1-4424-ba1e-7de1a75880f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:01:34.564819 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2adcd135-f0f1-4424-ba1e-7de1a75880f1 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 204 len: 0 microversion: 2.1 time: 0.476814 Jul 18 17:01:34.567400 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 536/1058] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:01:34 2022] DELETE /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:01:34.578381 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1ffc740f-8fe6-4743-b92a-79037526172c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:34.579166 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1ffc740f-8fe6-4743-b92a-79037526172c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:34.586389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ffc740f-8fe6-4743-b92a-79037526172c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.586845 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ffc740f-8fe6-4743-b92a-79037526172c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.587621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ffc740f-8fe6-4743-b92a-79037526172c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.588057 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ffc740f-8fe6-4743-b92a-79037526172c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.740948 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1ffc740f-8fe6-4743-b92a-79037526172c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:34.750259 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1ffc740f-8fe6-4743-b92a-79037526172c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1576 microversion: 2.1 time: 0.177608 Jul 18 17:01:34.751214 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 523/1059] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:34 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:35.771341 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-32a7bcaa-409f-4e75-9765-a5db3e44e9ca tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:35.772168 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-32a7bcaa-409f-4e75-9765-a5db3e44e9ca tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:35.779374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-32a7bcaa-409f-4e75-9765-a5db3e44e9ca tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.779819 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-32a7bcaa-409f-4e75-9765-a5db3e44e9ca tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.780585 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-32a7bcaa-409f-4e75-9765-a5db3e44e9ca tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.781043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-32a7bcaa-409f-4e75-9765-a5db3e44e9ca tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.922062 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-32a7bcaa-409f-4e75-9765-a5db3e44e9ca tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:35.930240 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-32a7bcaa-409f-4e75-9765-a5db3e44e9ca tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1576 microversion: 2.1 time: 0.163774 Jul 18 17:01:35.931036 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 537/1060] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:35 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:36.947982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-80fc68df-58fc-428a-aa4a-497449e6dedb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:36.948650 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-80fc68df-58fc-428a-aa4a-497449e6dedb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:36.956225 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80fc68df-58fc-428a-aa4a-497449e6dedb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.956798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80fc68df-58fc-428a-aa4a-497449e6dedb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.957620 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80fc68df-58fc-428a-aa4a-497449e6dedb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.958048 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-80fc68df-58fc-428a-aa4a-497449e6dedb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.038819 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-80fc68df-58fc-428a-aa4a-497449e6dedb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:37.047680 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-80fc68df-58fc-428a-aa4a-497449e6dedb tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1390 microversion: 2.1 time: 0.103589 Jul 18 17:01:37.048264 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 524/1061] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:36 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1390 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:37.050597 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-2a936c41-bdc6-40ec-9145-b81b33b36ca8 req-b4926064-d334-46bf-a9c2-8177a38ebb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff32d36-ec8b-470f-8b36-0f2299cfadd0", "name": "network-vif-deleted", "tag": "342742a0-e5ef-4303-9038-522eb8c8e202"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:37.060261 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-2a936c41-bdc6-40ec-9145-b81b33b36ca8 req-b4926064-d334-46bf-a9c2-8177a38ebb7d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:37.066293 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-2a936c41-bdc6-40ec-9145-b81b33b36ca8 req-b4926064-d334-46bf-a9c2-8177a38ebb7d service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.071840 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-2a936c41-bdc6-40ec-9145-b81b33b36ca8 req-b4926064-d334-46bf-a9c2-8177a38ebb7d service nova] Creating event network-vif-deleted:342742a0-e5ef-4303-9038-522eb8c8e202 for instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 on hv-cinder-84617 Jul 18 17:01:37.077677 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-2a936c41-bdc6-40ec-9145-b81b33b36ca8 req-b4926064-d334-46bf-a9c2-8177a38ebb7d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031069 Jul 18 17:01:37.078268 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 538/1062] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:38.064715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:38.065442 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:38.072310 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.078053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.078053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.078053 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.105225 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.105669 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.106117 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lazy-loading 'fault' on Instance uuid cff32d36-ec8b-470f-8b36-0f2299cfadd0 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:01:38.147595 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:38.156124 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e710b5a4-40b0-460f-ac06-969f516f5e19 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 200 len: 1230 microversion: 2.1 time: 0.095520 Jul 18 17:01:38.156785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 525/1063] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:38 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:39.175330 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:39.176025 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: cff32d36-ec8b-470f-8b36-0f2299cfadd0] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:39.182434 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.182954 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.183713 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.184151 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.198107 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] HTTP exception thrown: Instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 could not be found. Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Request method failure captured: Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 HTTP/1.1 Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZAq5Av5FCTu5VQPKY-YGaYzZ-DOp7zKd1cyuNw78Zypqy13Um9sWk-WqVBXPcH7Ac7znuC8MxTwaW7GcrjqtaOOcGBwRqmOPcWzK4fhku8uBtGIDRBicV4ofD8MJ8jsB1TtV2kY4AheQeademACMNHE2uhnDE6CNkWZ2W4vQwltlFs Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:01:39.199736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d68154d9fdb40f0848b676c1fed6a50", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}] Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-TestVolumeBootPattern-1667440206-project Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: cd69c5111dac492a9177128317f0962a Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-TestVolumeBootPattern-1667440206-project Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 could not be found. Jul 18 17:01:39.201526 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': 'cff32d36-ec8b-470f-8b36-0f2299cfadd0'} Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 could not be found. Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:39.202527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 could not be found. Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 could not be found. Jul 18 17:01:39.204161 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:39.205756 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Returning 404 to user: Instance cff32d36-ec8b-470f-8b36-0f2299cfadd0 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:39.205756 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-752c9e66-59a3-4c31-b358-77f77b75afe5 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0" status: 404 len: 111 microversion: 2.1 time: 0.030810 Jul 18 17:01:39.205756 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 539/1064] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:39 2022] GET /compute/v2.1/servers/cff32d36-ec8b-470f-8b36-0f2299cfadd0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:01:42.784578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fe6c4744-1233-415c-94f0-768b1d658f9b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:42.785162 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-1ab422cc-8b49-4356-9ba9-76629d355625 req-ba75382a-842a-414b-b8b3-97a4df1363ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e96cdd8-f199-4396-ae3b-4d4abbb43ba3", "tag": "398167d3-62f4-4f3b-bbd8-8c2be263a68e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:42.786555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fe6c4744-1233-415c-94f0-768b1d658f9b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:42.793995 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-1ab422cc-8b49-4356-9ba9-76629d355625 req-ba75382a-842a-414b-b8b3-97a4df1363ca service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.794439 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-1ab422cc-8b49-4356-9ba9-76629d355625 req-ba75382a-842a-414b-b8b3-97a4df1363ca service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.794732 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fe6c4744-1233-415c-94f0-768b1d658f9b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.795973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fe6c4744-1233-415c-94f0-768b1d658f9b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.796865 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fe6c4744-1233-415c-94f0-768b1d658f9b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.797443 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fe6c4744-1233-415c-94f0-768b1d658f9b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.809550 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-1ab422cc-8b49-4356-9ba9-76629d355625 req-ba75382a-842a-414b-b8b3-97a4df1363ca service nova] Creating event network-changed:398167d3-62f4-4f3b-bbd8-8c2be263a68e for instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 on hv-cinder-84617 Jul 18 17:01:42.815480 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-1ab422cc-8b49-4356-9ba9-76629d355625 req-ba75382a-842a-414b-b8b3-97a4df1363ca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034012 Jul 18 17:01:42.822032 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 540/1065] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:42.826117 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fe6c4744-1233-415c-94f0-768b1d658f9b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:01:43.146981 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fe6c4744-1233-415c-94f0-768b1d658f9b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 204 len: 0 microversion: 2.1 time: 0.366729 Jul 18 17:01:43.147813 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 526/1066] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:01:42 2022] DELETE /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:01:43.156816 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-16d46f47-fea9-49e8-ba30-70cb74c68b62 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:43.157649 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-16d46f47-fea9-49e8-ba30-70cb74c68b62 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:43.164003 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-16d46f47-fea9-49e8-ba30-70cb74c68b62 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.165632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-16d46f47-fea9-49e8-ba30-70cb74c68b62 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.165632 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-16d46f47-fea9-49e8-ba30-70cb74c68b62 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.166058 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-16d46f47-fea9-49e8-ba30-70cb74c68b62 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.306417 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-16d46f47-fea9-49e8-ba30-70cb74c68b62 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:43.314870 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-16d46f47-fea9-49e8-ba30-70cb74c68b62 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1576 microversion: 2.1 time: 0.162671 Jul 18 17:01:43.315444 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 541/1067] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:43 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:44.332268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1c54400b-cdb0-4fbe-8ca5-9f4a94f9886c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:44.332990 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1c54400b-cdb0-4fbe-8ca5-9f4a94f9886c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:44.339617 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1c54400b-cdb0-4fbe-8ca5-9f4a94f9886c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.340065 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1c54400b-cdb0-4fbe-8ca5-9f4a94f9886c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.340828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1c54400b-cdb0-4fbe-8ca5-9f4a94f9886c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.341285 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1c54400b-cdb0-4fbe-8ca5-9f4a94f9886c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.550005 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1c54400b-cdb0-4fbe-8ca5-9f4a94f9886c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:44.557725 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1c54400b-cdb0-4fbe-8ca5-9f4a94f9886c tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1576 microversion: 2.1 time: 0.229788 Jul 18 17:01:44.558296 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 527/1068] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:44 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:45.554272 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-b9a8d50d-578c-477b-88ff-dbd666170694 req-901cf25c-525d-4325-a08e-c4e4c752f3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e96cdd8-f199-4396-ae3b-4d4abbb43ba3", "name": "network-vif-deleted", "tag": "398167d3-62f4-4f3b-bbd8-8c2be263a68e"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:45.562700 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-b9a8d50d-578c-477b-88ff-dbd666170694 req-901cf25c-525d-4325-a08e-c4e4c752f3f8 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.563147 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-b9a8d50d-578c-477b-88ff-dbd666170694 req-901cf25c-525d-4325-a08e-c4e4c752f3f8 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.574681 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-b9a8d50d-578c-477b-88ff-dbd666170694 req-901cf25c-525d-4325-a08e-c4e4c752f3f8 service nova] Creating event network-vif-deleted:398167d3-62f4-4f3b-bbd8-8c2be263a68e for instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 on hv-cinder-84617 Jul 18 17:01:45.575591 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b9836cb5-54a9-45bc-9977-d6ede8888c40 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:45.576230 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b9836cb5-54a9-45bc-9977-d6ede8888c40 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:45.582201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-b9a8d50d-578c-477b-88ff-dbd666170694 req-901cf25c-525d-4325-a08e-c4e4c752f3f8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030078 Jul 18 17:01:45.582944 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 542/1069] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:45.584149 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b9836cb5-54a9-45bc-9977-d6ede8888c40 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.584595 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b9836cb5-54a9-45bc-9977-d6ede8888c40 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.585412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b9836cb5-54a9-45bc-9977-d6ede8888c40 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.585856 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b9836cb5-54a9-45bc-9977-d6ede8888c40 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.654201 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b9836cb5-54a9-45bc-9977-d6ede8888c40 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:45.662861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b9836cb5-54a9-45bc-9977-d6ede8888c40 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1390 microversion: 2.1 time: 0.091158 Jul 18 17:01:45.663442 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 528/1070] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:45 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:46.683618 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:46.684983 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:46.696045 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.697015 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.706687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.706687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.736554 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.737080 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.737539 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lazy-loading 'fault' on Instance uuid 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:01:46.779214 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd69c5111dac492a9177128317f0962a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d68154d9fdb40f0848b676c1fed6a50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:46.787325 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0bf78f77-8e2b-4658-a450-cad1adae8678 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 200 len: 1229 microversion: 2.1 time: 0.111446 Jul 18 17:01:46.787897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 543/1071] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:46 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:47.805093 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:47.805720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:47.812130 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.812570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.813366 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.813782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.827770 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] HTTP exception thrown: Instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 could not be found. Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Request method failure captured: Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 HTTP/1.1 Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZAq5Av5FCTu5VQPKY-YGaYzZ-DOp7zKd1cyuNw78Zypqy13Um9sWk-WqVBXPcH7Ac7znuC8MxTwaW7GcrjqtaOOcGBwRqmOPcWzK4fhku8uBtGIDRBicV4ofD8MJ8jsB1TtV2kY4AheQeademACMNHE2uhnDE6CNkWZ2W4vQwltlFs Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:01:47.829398 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d68154d9fdb40f0848b676c1fed6a50", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}] Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-TestVolumeBootPattern-1667440206-project Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: cd69c5111dac492a9177128317f0962a Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-TestVolumeBootPattern-1667440206-project Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 could not be found. Jul 18 17:01:47.831000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '5e96cdd8-f199-4396-ae3b-4d4abbb43ba3'} Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 could not be found. Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:47.831857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 could not be found. Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 could not be found. Jul 18 17:01:47.833792 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:47.835428 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Returning 404 to user: Instance 5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:47.835428 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-90a0ada4-5a7b-40e2-afb2-8b9772757636 tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3" status: 404 len: 111 microversion: 2.1 time: 0.029546 Jul 18 17:01:47.835428 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 529/1072] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:47 2022] GET /compute/v2.1/servers/5e96cdd8-f199-4396-ae3b-4d4abbb43ba3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:01:48.333745 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:48.334250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:48.340733 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.341216 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.342622 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.343080 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.356601 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] HTTP exception thrown: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Request method failure captured: Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 HTTP/1.1 Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZAq5Av5FCTu5VQPKY-YGaYzZ-DOp7zKd1cyuNw78Zypqy13Um9sWk-WqVBXPcH7Ac7znuC8MxTwaW7GcrjqtaOOcGBwRqmOPcWzK4fhku8uBtGIDRBicV4ofD8MJ8jsB1TtV2kY4AheQeademACMNHE2uhnDE6CNkWZ2W4vQwltlFs Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:01:48.359262 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d68154d9fdb40f0848b676c1fed6a50", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}] Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-TestVolumeBootPattern-1667440206-project Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: cd69c5111dac492a9177128317f0962a Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-TestVolumeBootPattern-1667440206-project Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.361108 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': 'f69c45d3-ad0f-4135-9752-32f5baf001b2'} Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:48.362044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.363779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.365407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Returning 404 to user: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:48.365407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6506951b-2afb-42b2-b2cd-f3ac0ab8b06b tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 404 len: 111 microversion: 2.1 time: 0.029923 Jul 18 17:01:48.365407 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 544/1073] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:01:48 2022] DELETE /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:01:48.368165 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:48.368780 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] [instance: f69c45d3-ad0f-4135-9752-32f5baf001b2] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:48.374995 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.375449 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.376250 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.376689 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.390460 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] HTTP exception thrown: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Request method failure captured: Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 HTTP/1.1 Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZAq5Av5FCTu5VQPKY-YGaYzZ-DOp7zKd1cyuNw78Zypqy13Um9sWk-WqVBXPcH7Ac7znuC8MxTwaW7GcrjqtaOOcGBwRqmOPcWzK4fhku8uBtGIDRBicV4ofD8MJ8jsB1TtV2kY4AheQeademACMNHE2uhnDE6CNkWZ2W4vQwltlFs Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:01:48.391975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d68154d9fdb40f0848b676c1fed6a50", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d68154d9fdb40f0848b676c1fed6a50"}]}] Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 5d68154d9fdb40f0848b676c1fed6a50 Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-TestVolumeBootPattern-1667440206 Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-TestVolumeBootPattern-1667440206-project Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: cd69c5111dac492a9177128317f0962a Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-TestVolumeBootPattern-1667440206-project Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.395268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': 'f69c45d3-ad0f-4135-9752-32f5baf001b2'} Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:48.396236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. Jul 18 17:01:48.398627 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:48.402033 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Returning 404 to user: Instance f69c45d3-ad0f-4135-9752-32f5baf001b2 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:48.402033 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0785680e-c772-472f-8b8a-e4a040b34c0a tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2" status: 404 len: 111 microversion: 2.1 time: 0.029008 Jul 18 17:01:48.402033 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 530/1074] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:48 2022] GET /compute/v2.1/servers/f69c45d3-ad0f-4135-9752-32f5baf001b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:01:49.878527 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-5d1fed0e-4c34-43ac-a968-fd39b132d7bc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] Calling method '.version_select at 0x7fd4f50e3d30>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:49.953273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-5d1fed0e-4c34-43ac-a968-fd39b132d7bc tempest-TestVolumeBootPattern-1667440206 tempest-TestVolumeBootPattern-1667440206-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-328566045" status: 202 len: 0 microversion: 2.1 time: 0.081111 Jul 18 17:01:49.953857 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 545/1075] 10.222.0.88 () {58 vars in 1259 bytes} [Mon Jul 18 17:01:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-328566045 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:01:50.403189 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bc5efef3-c8ca-4e4a-b550-9bfb5fbaffa7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:50.404178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-bc5efef3-c8ca-4e4a-b550-9bfb5fbaffa7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:50.410897 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bc5efef3-c8ca-4e4a-b550-9bfb5fbaffa7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.411354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bc5efef3-c8ca-4e4a-b550-9bfb5fbaffa7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.412135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bc5efef3-c8ca-4e4a-b550-9bfb5fbaffa7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.412575 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bc5efef3-c8ca-4e4a-b550-9bfb5fbaffa7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.444154 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-bc5efef3-c8ca-4e4a-b550-9bfb5fbaffa7 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044958 Jul 18 17:01:50.444748 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 531/1076] 10.222.0.88 () {60 vars in 1342 bytes} [Mon Jul 18 17:01:50 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:50.505406 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cca25f4c-13d2-4447-9ee3-1b143a22ba85 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:50.505905 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cca25f4c-13d2-4447-9ee3-1b143a22ba85 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:50.513195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cca25f4c-13d2-4447-9ee3-1b143a22ba85 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.513801 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cca25f4c-13d2-4447-9ee3-1b143a22ba85 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.514466 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cca25f4c-13d2-4447-9ee3-1b143a22ba85 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.514902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cca25f4c-13d2-4447-9ee3-1b143a22ba85 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.541384 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cca25f4c-13d2-4447-9ee3-1b143a22ba85 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:01:50.790503 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cca25f4c-13d2-4447-9ee3-1b143a22ba85 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 204 len: 0 microversion: 2.20 time: 0.288679 Jul 18 17:01:50.791154 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 546/1077] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 17:01:50 2022] DELETE /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 17:01:50.800338 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:50.802741 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:50.809221 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.809844 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.810616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.811143 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.944234 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:50.952699 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:50.954229 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:50.955389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9f7e5e8f-bf2b-4cff-999a-835ebe4e2a3d tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.159205 Jul 18 17:01:50.955960 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 532/1078] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:50 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:51.974256 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:51.974961 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:51.981848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.993314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.993314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.993314 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.122227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:52.131533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:52.133200 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:52.134532 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-b10def53-5acf-4064-9466-79d93593e1eb tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.164580 Jul 18 17:01:52.135088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 547/1079] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:51 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:53.153818 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:53.154451 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:53.160957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.161412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.162186 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.162624 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.480863 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.490674 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.492740 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b3c774c1b04537a970c1e7dfdd6ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034f143ba31148c0939a06296ec18a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.494021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0c843c6a-53bc-49d5-a184-266bf51d1138 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 200 len: 1721 microversion: 2.20 time: 0.344217 Jul 18 17:01:53.494747 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 533/1080] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:53 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 1721 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:01:53.646857 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:01:53.647135 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 17:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:01:53.863354 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-6e102109-5653-4e23-b573-e6c6fb0d33a3 req-8ea2b5cb-6c57-4fdb-84ec-ba61841e2e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920250a7-2997-49fb-9430-de226b904c0d", "name": "network-vif-deleted", "tag": "03d2b05e-f777-497c-a943-ec3d77aa90a3"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:53.883270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-6e102109-5653-4e23-b573-e6c6fb0d33a3 req-8ea2b5cb-6c57-4fdb-84ec-ba61841e2e0a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.883875 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-6e102109-5653-4e23-b573-e6c6fb0d33a3 req-8ea2b5cb-6c57-4fdb-84ec-ba61841e2e0a service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.906571 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-6e102109-5653-4e23-b573-e6c6fb0d33a3 req-8ea2b5cb-6c57-4fdb-84ec-ba61841e2e0a service nova] Creating event network-vif-deleted:03d2b05e-f777-497c-a943-ec3d77aa90a3 for instance 920250a7-2997-49fb-9430-de226b904c0d on hv-cinder-84617 Jul 18 17:01:53.911504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-6e102109-5653-4e23-b573-e6c6fb0d33a3 req-8ea2b5cb-6c57-4fdb-84ec-ba61841e2e0a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052247 Jul 18 17:01:53.912114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 548/1081] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:54.514719 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:54.515351 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:54.528475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.528958 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.531196 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.531709 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.550912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] HTTP exception thrown: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Request method failure captured: Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d HTTP/1.1 Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZC1zjL_6XS94alptGRAiGmz05TJcOQ_-BSvRg20mCEkxgFEtckxgIIGUkwMr2qOgM-8TXyY9QAgnwSzqK1NUtljjcHOxUWkUp-bqX59mhNLifTQ651gitv35rwNphMTDQeDZ4eypM8PNA4Iso_R1Y69fIhCXDaU4P4yf-4kzHKxYos Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:01:54.552762 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/034f143ba31148c0939a06296ec18a96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_034f143ba31148c0939a06296ec18a96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}] Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 24b3c774c1b04537a970c1e7dfdd6ac3 Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:54.554578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '920250a7-2997-49fb-9430-de226b904c0d'} Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:54.555542 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:54.557113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:54.560069 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Returning 404 to user: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:54.561202 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-05351c9f-baa5-4c42-80b2-9d0efbd95ddc tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 404 len: 111 microversion: 2.20 time: 0.051729 Jul 18 17:01:54.567049 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 534/1082] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:54 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:01:54.572432 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-96b9ffef-9a4b-41c5-ad66-42cbaaa51f10 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '.version_select at 0x7fd4f5172700>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:54.660514 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-96b9ffef-9a4b-41c5-ad66-42cbaaa51f10 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176525098" status: 204 len: 0 microversion: 2.20 time: 0.092419 Jul 18 17:01:54.673057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 549/1083] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 18 17:01:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176525098 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 17:01:55.524207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-f784b555-e463-4ea4-a59e-862b9394e9a7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:55.525456 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-f784b555-e463-4ea4-a59e-862b9394e9a7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:55.535530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f784b555-e463-4ea4-a59e-862b9394e9a7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.535983 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f784b555-e463-4ea4-a59e-862b9394e9a7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.536860 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f784b555-e463-4ea4-a59e-862b9394e9a7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.537326 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-f784b555-e463-4ea4-a59e-862b9394e9a7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.575713 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-f784b555-e463-4ea4-a59e-862b9394e9a7 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/ips" status: 200 len: 149 microversion: 2.1 time: 0.056078 Jul 18 17:01:55.577310 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 535/1084] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 17:01:55 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/ips => generated 149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:57.105297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:57.106000 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:57.113099 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.113557 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.114351 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.114791 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.129419 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] HTTP exception thrown: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Request method failure captured: Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d HTTP/1.1 Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZC1zjL_6XS94alptGRAiGmz05TJcOQ_-BSvRg20mCEkxgFEtckxgIIGUkwMr2qOgM-8TXyY9QAgnwSzqK1NUtljjcHOxUWkUp-bqX59mhNLifTQ651gitv35rwNphMTDQeDZ4eypM8PNA4Iso_R1Y69fIhCXDaU4P4yf-4kzHKxYos Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:01:57.131121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/034f143ba31148c0939a06296ec18a96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_034f143ba31148c0939a06296ec18a96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}] Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 24b3c774c1b04537a970c1e7dfdd6ac3 Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.132825 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '920250a7-2997-49fb-9430-de226b904c0d'} Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:57.133835 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.135485 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.137138 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Returning 404 to user: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:57.137138 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-0af84b62-638a-48bc-b591-064c45bfd132 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 404 len: 111 microversion: 2.20 time: 0.032107 Jul 18 17:01:57.137138 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 550/1085] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 17:01:57 2022] DELETE /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:01:57.141730 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:57.142781 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 920250a7-2997-49fb-9430-de226b904c0d] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:57.150131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.150608 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.151442 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.151900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.165361 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] HTTP exception thrown: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Request method failure captured: Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d HTTP/1.1 Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZC1zjL_6XS94alptGRAiGmz05TJcOQ_-BSvRg20mCEkxgFEtckxgIIGUkwMr2qOgM-8TXyY9QAgnwSzqK1NUtljjcHOxUWkUp-bqX59mhNLifTQ651gitv35rwNphMTDQeDZ4eypM8PNA4Iso_R1Y69fIhCXDaU4P4yf-4kzHKxYos Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:01:57.166884 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/034f143ba31148c0939a06296ec18a96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_034f143ba31148c0939a06296ec18a96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}] Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 24b3c774c1b04537a970c1e7dfdd6ac3 Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.168720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '920250a7-2997-49fb-9430-de226b904c0d'} Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:57.169539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. Jul 18 17:01:57.174643 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:57.178090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Returning 404 to user: Instance 920250a7-2997-49fb-9430-de226b904c0d could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:57.178090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-bb005e87-fd0d-45d2-af80-a60e5801ec32 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d" status: 404 len: 111 microversion: 2.20 time: 0.030527 Jul 18 17:01:57.178090 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 536/1086] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:57 2022] GET /compute/v2.1/servers/920250a7-2997-49fb-9430-de226b904c0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:01:57.231496 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d1920edb-89d2-4c08-8aa1-b5322400d71f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ed03758-276b-4be6-a93e-fb7388024850"}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:57.232641 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d1920edb-89d2-4c08-8aa1-b5322400d71f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:57.239842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1920edb-89d2-4c08-8aa1-b5322400d71f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.240254 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1920edb-89d2-4c08-8aa1-b5322400d71f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.241122 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1920edb-89d2-4c08-8aa1-b5322400d71f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.241968 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d1920edb-89d2-4c08-8aa1-b5322400d71f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.995322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d1920edb-89d2-4c08-8aa1-b5322400d71f tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "POST /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767666 Jul 18 17:01:57.996628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 551/1087] 10.222.0.88 () {60 vars in 1322 bytes} [Mon Jul 18 17:01:57 2022] POST /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:58.493018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:58.493532 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:58.500731 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.501211 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.501992 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.502428 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.516771 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] HTTP exception thrown: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Request method failure captured: Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: DELETE /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f HTTP/1.1 Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZC1zjL_6XS94alptGRAiGmz05TJcOQ_-BSvRg20mCEkxgFEtckxgIIGUkwMr2qOgM-8TXyY9QAgnwSzqK1NUtljjcHOxUWkUp-bqX59mhNLifTQ651gitv35rwNphMTDQeDZ4eypM8PNA4Iso_R1Y69fIhCXDaU4P4yf-4kzHKxYos Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:01:58.518349 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/034f143ba31148c0939a06296ec18a96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_034f143ba31148c0939a06296ec18a96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}] Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 24b3c774c1b04537a970c1e7dfdd6ac3 Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.519999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '48753a71-ab88-464c-91fd-21fd8f63c17f'} Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:58.520935 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.523378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.525032 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Returning 404 to user: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:58.525032 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1ab81122-ed35-4444-b730-6e95dec78816 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 404 len: 111 microversion: 2.20 time: 0.030735 Jul 18 17:01:58.525032 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 537/1088] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 18 17:01:58 2022] DELETE /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:01:58.529479 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:58.530206 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] [instance: 48753a71-ab88-464c-91fd-21fd8f63c17f] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:58.537443 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.537899 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.538679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.539120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.555559 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] HTTP exception thrown: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Request method failure captured: Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f HTTP/1.1 Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZC1zjL_6XS94alptGRAiGmz05TJcOQ_-BSvRg20mCEkxgFEtckxgIIGUkwMr2qOgM-8TXyY9QAgnwSzqK1NUtljjcHOxUWkUp-bqX59mhNLifTQ651gitv35rwNphMTDQeDZ4eypM8PNA4Iso_R1Y69fIhCXDaU4P4yf-4kzHKxYos Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:01:58.557249 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/034f143ba31148c0939a06296ec18a96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_034f143ba31148c0939a06296ec18a96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/034f143ba31148c0939a06296ec18a96"}]}] Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 034f143ba31148c0939a06296ec18a96 Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282902585 Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 24b3c774c1b04537a970c1e7dfdd6ac3 Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282902585-project Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.559201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '48753a71-ab88-464c-91fd-21fd8f63c17f'} Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:58.560115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. Jul 18 17:01:58.562360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:01:58.563731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] Returning 404 to user: Instance 48753a71-ab88-464c-91fd-21fd8f63c17f could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:58.563731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-50783b2b-9e46-42e8-8794-3442b0b76486 tempest-AttachVolumeShelveTestJSON-282902585 tempest-AttachVolumeShelveTestJSON-282902585-project] 10.222.0.88 "GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f" status: 404 len: 111 microversion: 2.20 time: 0.033791 Jul 18 17:01:58.563731 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 552/1089] 10.222.0.88 () {60 vars in 1276 bytes} [Mon Jul 18 17:01:58 2022] GET /compute/v2.1/servers/48753a71-ab88-464c-91fd-21fd8f63c17f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:02:04.059711 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e7e5adab-1c15-48f3-9991-260a7cacf2bf tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Action: 'create', calling method: .version_select at 0x7fd4f513b280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1645615430"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:04.655345 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e7e5adab-1c15-48f3-9991-260a7cacf2bf tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.713655 Jul 18 17:02:04.661200 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 538/1090] 10.222.0.88 () {60 vars in 1154 bytes} [Mon Jul 18 17:02:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 715 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 17:02:04.667120 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-8a9061af-8960-4bb3-97bf-352bccfb4c29 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f524f430>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:04.716450 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-8a9061af-8960-4bb3-97bf-352bccfb4c29 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd" status: 200 len: 345 microversion: 2.1 time: 0.053064 Jul 18 17:02:04.717088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 553/1091] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 17:02:04 2022] GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:05.731665 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3c0399b5-fad7-4bb0-9eed-c29c3a72af18 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f50e09d0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:05.780562 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3c0399b5-fad7-4bb0-9eed-c29c3a72af18 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd" status: 200 len: 346 microversion: 2.1 time: 0.054927 Jul 18 17:02:05.781206 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 539/1092] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 17:02:05 2022] GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:05.791439 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-dae33442-a88b-4edc-a9cc-08cb1bf3bb5d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:05.791941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-dae33442-a88b-4edc-a9cc-08cb1bf3bb5d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:05.792174 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-c4dbd201-3929-4192-b2b3-b22af0aa1173 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Action: 'create', calling method: .version_select at 0x7fd4f53ca4c0>, body: {"snapshot": {"volume_id": "55692830-da2b-426b-a411-e512561d94dd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-226026642"}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:05.798122 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dae33442-a88b-4edc-a9cc-08cb1bf3bb5d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.798582 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dae33442-a88b-4edc-a9cc-08cb1bf3bb5d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.799586 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dae33442-a88b-4edc-a9cc-08cb1bf3bb5d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.800029 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-dae33442-a88b-4edc-a9cc-08cb1bf3bb5d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.802796 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:05.896165 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.objects.instance [None req-dae33442-a88b-4edc-a9cc-08cb1bf3bb5d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lazy-loading 'services' on Instance uuid 008f8524-193f-493a-81b0-9d55d0a0e838 {{(pid=124753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:02:06.160793 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-dae33442-a88b-4edc-a9cc-08cb1bf3bb5d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments/3ed03758-276b-4be6-a93e-fb7388024850" status: 202 len: 0 microversion: 2.1 time: 0.373515 Jul 18 17:02:06.161348 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 554/1093] 10.222.0.88 () {58 vars in 1415 bytes} [Mon Jul 18 17:02:05 2022] DELETE /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments/3ed03758-276b-4be6-a93e-fb7388024850 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:02:06.170079 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-59168743-07a0-4cc0-ab36-c7d09cdd0bb3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:06.171587 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-59168743-07a0-4cc0-ab36-c7d09cdd0bb3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:06.173667 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:06.178599 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-59168743-07a0-4cc0-ab36-c7d09cdd0bb3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.179052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-59168743-07a0-4cc0-ab36-c7d09cdd0bb3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.179848 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-59168743-07a0-4cc0-ab36-c7d09cdd0bb3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.180274 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-59168743-07a0-4cc0-ab36-c7d09cdd0bb3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.211033 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-59168743-07a0-4cc0-ab36-c7d09cdd0bb3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045093 Jul 18 17:02:06.215941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 555/1094] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:06 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:06.260018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-c4dbd201-3929-4192-b2b3-b22af0aa1173 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.471452 Jul 18 17:02:06.262118 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 540/1095] 10.222.0.88 () {60 vars in 1161 bytes} [Mon Jul 18 17:02:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:06.270941 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-284d7b32-701c-4166-909c-5d5e82904355 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f50e30d0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:06.303651 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-284d7b32-701c-4166-909c-5d5e82904355 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 200 len: 286 microversion: 2.1 time: 0.036526 Jul 18 17:02:06.304216 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 556/1096] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 17:02:06 2022] GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:06.313698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5ff79803-ad95-436e-865f-ebc6f5c3e732 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f5440d30>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:06.344022 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5ff79803-ad95-436e-865f-ebc6f5c3e732 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033978 Jul 18 17:02:06.344782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 541/1097] 10.222.0.88 () {58 vars in 1139 bytes} [Mon Jul 18 17:02:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:06.355028 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-44f7ede1-39d4-46b2-b46d-717809d9ad4d tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f9a97b80>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:06.386051 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-44f7ede1-39d4-46b2-b46d-717809d9ad4d tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 200 len: 286 microversion: 2.1 time: 0.035095 Jul 18 17:02:06.386639 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 557/1098] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 17:02:06 2022] GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:07.226236 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-3763af43-df2f-40bd-8d03-635c9521d72d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:07.227061 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-3763af43-df2f-40bd-8d03-635c9521d72d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:07.229418 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:07.234415 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3763af43-df2f-40bd-8d03-635c9521d72d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.234868 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3763af43-df2f-40bd-8d03-635c9521d72d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.235644 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3763af43-df2f-40bd-8d03-635c9521d72d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.236078 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-3763af43-df2f-40bd-8d03-635c9521d72d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.238576 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:07.268147 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-3763af43-df2f-40bd-8d03-635c9521d72d tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046401 Jul 18 17:02:07.268725 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 542/1099] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:07 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:07.398467 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-592b1fe8-a0e9-4eb7-b9d0-d80e37d84b14 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f524f0d0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:07.429416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-592b1fe8-a0e9-4eb7-b9d0-d80e37d84b14 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 200 len: 286 microversion: 2.1 time: 0.035400 Jul 18 17:02:07.429980 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 558/1100] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 17:02:07 2022] GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:08.280230 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-fcd106c9-eaf8-43d3-b68f-e2910ca101e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:08.281227 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-fcd106c9-eaf8-43d3-b68f-e2910ca101e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:08.288904 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fcd106c9-eaf8-43d3-b68f-e2910ca101e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:08.289370 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fcd106c9-eaf8-43d3-b68f-e2910ca101e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.290148 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fcd106c9-eaf8-43d3-b68f-e2910ca101e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:08.290583 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-fcd106c9-eaf8-43d3-b68f-e2910ca101e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.320836 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-fcd106c9-eaf8-43d3-b68f-e2910ca101e3 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Jul 18 17:02:08.321431 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 543/1101] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:08 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:08.442098 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4ba284f8-abd8-42d0-9c67-995f44aee1ee tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f50e3310>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:08.470779 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4ba284f8-abd8-42d0-9c67-995f44aee1ee tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 200 len: 286 microversion: 2.1 time: 0.033283 Jul 18 17:02:08.471337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 559/1102] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 17:02:08 2022] GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:09.332110 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b4620771-b5e3-4106-ac07-8ba77ad9033a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:09.333125 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b4620771-b5e3-4106-ac07-8ba77ad9033a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:09.341314 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b4620771-b5e3-4106-ac07-8ba77ad9033a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.341828 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b4620771-b5e3-4106-ac07-8ba77ad9033a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.342634 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b4620771-b5e3-4106-ac07-8ba77ad9033a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.343075 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b4620771-b5e3-4106-ac07-8ba77ad9033a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.376861 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b4620771-b5e3-4106-ac07-8ba77ad9033a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048757 Jul 18 17:02:09.377535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 544/1103] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:09 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:09.483767 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-46ee718e-e316-405f-9de7-ddfd8bb6a12c tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f524fa60>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:09.513245 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-46ee718e-e316-405f-9de7-ddfd8bb6a12c tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 200 len: 286 microversion: 2.1 time: 0.034549 Jul 18 17:02:09.514393 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 560/1104] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 17:02:09 2022] GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:10.389267 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2345771f-e956-40e8-b104-52a15dce3723 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.390209 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2345771f-e956-40e8-b104-52a15dce3723 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:10.397547 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2345771f-e956-40e8-b104-52a15dce3723 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.397998 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2345771f-e956-40e8-b104-52a15dce3723 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.398867 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2345771f-e956-40e8-b104-52a15dce3723 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.399308 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2345771f-e956-40e8-b104-52a15dce3723 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.430893 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2345771f-e956-40e8-b104-52a15dce3723 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045812 Jul 18 17:02:10.431475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 545/1105] 10.222.0.88 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:10 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 17:02:10.488645 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-d9b96949-c904-471e-87e8-59c45d62c415 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.489201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d9b96949-c904-471e-87e8-59c45d62c415 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:10.495638 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d9b96949-c904-471e-87e8-59c45d62c415 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.496090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d9b96949-c904-471e-87e8-59c45d62c415 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.496851 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d9b96949-c904-471e-87e8-59c45d62c415 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.497316 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-d9b96949-c904-471e-87e8-59c45d62c415 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.522484 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-d9b96949-c904-471e-87e8-59c45d62c415 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:02:10.526112 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9d8e3ea6-29c6-4278-ad17-81830ba14b1a tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f5362550>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.555954 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9d8e3ea6-29c6-4278-ad17-81830ba14b1a tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 200 len: 287 microversion: 2.1 time: 0.034386 Jul 18 17:02:10.556529 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 546/1106] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 17:02:10 2022] GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:10.567429 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-813cec11-7400-40bf-874d-8d6853bc2aa2 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f53b48b0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.694405 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-813cec11-7400-40bf-874d-8d6853bc2aa2 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "DELETE /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 202 len: 0 microversion: 2.1 time: 0.131028 Jul 18 17:02:10.694994 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 547/1107] 10.222.0.88 () {58 vars in 1253 bytes} [Mon Jul 18 17:02:10 2022] DELETE /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:02:10.702782 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-24c49cdb-4f11-4643-bec0-91dd196a4e65 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f53f3280>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.735422 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-24c49cdb-4f11-4643-bec0-91dd196a4e65 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 200 len: 286 microversion: 2.1 time: 0.036215 Jul 18 17:02:10.736238 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 548/1108] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 17:02:10 2022] GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:10.772561 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-d9b96949-c904-471e-87e8-59c45d62c415 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 204 len: 0 microversion: 2.1 time: 0.288219 Jul 18 17:02:10.773178 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 561/1109] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:02:10 2022] DELETE /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:02:10.782766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6cc790ae-fc5d-4401-826b-bb28c433fedf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.783529 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6cc790ae-fc5d-4401-826b-bb28c433fedf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:10.790464 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6cc790ae-fc5d-4401-826b-bb28c433fedf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.790934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6cc790ae-fc5d-4401-826b-bb28c433fedf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.791797 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6cc790ae-fc5d-4401-826b-bb28c433fedf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.792232 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6cc790ae-fc5d-4401-826b-bb28c433fedf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.931331 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6cc790ae-fc5d-4401-826b-bb28c433fedf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:10.950231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6cc790ae-fc5d-4401-826b-bb28c433fedf tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1679 microversion: 2.1 time: 0.163297 Jul 18 17:02:10.950231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 549/1110] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:10 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:11.748094 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-11c3fdeb-a237-4019-8b83-f435098a6e96 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f9a871f0>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:11.773340 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-11c3fdeb-a237-4019-8b83-f435098a6e96 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] HTTP exception thrown: Snapshot 4b18670d-4e8d-4b40-adc2-3c8fb55ae063 could not be found. Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-11c3fdeb-a237-4019-8b83-f435098a6e96 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Request method failure captured: Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 HTTP/1.1 Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZILtHy4Ncy2PIF-3HuuIE-IXBrUrTg_LGdXC8DKLa2X_Z5c3pFRzejdCvpeWYIvlzOCdHn32wKdEcq-SOe6adxCRdUxr3F6iT171KoM5sV6PCBce4WqRA0L3G4XCHPa3xGJu3meBscAVcooh83fzx6Xep7K6gaoGxpQzY-yRlA_4hs Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: f0b6282ccd52404286aa7442e78e8086 Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:02:11.775679 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f0b6282ccd52404286aa7442e78e8086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f0b6282ccd52404286aa7442e78e8086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f0b6282ccd52404286aa7442e78e8086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f0b6282ccd52404286aa7442e78e8086"}]}] Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: f0b6282ccd52404286aa7442e78e8086 Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesSnapshotsTestJSON-1345517208-project Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 9c39b1e3315348799c5bd93c8b0535fd Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1345517208-project Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Snapshot 4b18670d-4e8d-4b40-adc2-3c8fb55ae063 could not be found. Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '4b18670d-4e8d-4b40-adc2-3c8fb55ae063'} Jul 18 17:02:11.777273 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4b18670d-4e8d-4b40-adc2-3c8fb55ae063 could not be found. (HTTP 404) (Request-ID: req-55654936-79bb-4c35-b1db-d85c3c60c09e) Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:11.778250 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 17:02:11.780297 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4b18670d-4e8d-4b40-adc2-3c8fb55ae063 could not be found. Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 17:02:11.781953 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4b18670d-4e8d-4b40-adc2-3c8fb55ae063 could not be found. Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4b18670d-4e8d-4b40-adc2-3c8fb55ae063 could not be found. Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-11c3fdeb-a237-4019-8b83-f435098a6e96 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Returning 404 to user: Snapshot 4b18670d-4e8d-4b40-adc2-3c8fb55ae063 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:11.783513 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-11c3fdeb-a237-4019-8b83-f435098a6e96 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063" status: 404 len: 111 microversion: 2.1 time: 0.033281 Jul 18 17:02:11.784569 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 562/1111] 10.222.0.88 () {58 vars in 1250 bytes} [Mon Jul 18 17:02:11 2022] GET /compute/v2.1/os-snapshots/4b18670d-4e8d-4b40-adc2-3c8fb55ae063 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:11.786231 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-00c0b8ea-7a5b-4c4d-9a94-bcc9cb288e3a tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f53f39d0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:11.961366 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-c01c8d7f-9f96-483c-be6a-f5cffbfac8fe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:11.962096 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-c01c8d7f-9f96-483c-be6a-f5cffbfac8fe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:11.968780 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c01c8d7f-9f96-483c-be6a-f5cffbfac8fe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.969190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c01c8d7f-9f96-483c-be6a-f5cffbfac8fe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.970021 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c01c8d7f-9f96-483c-be6a-f5cffbfac8fe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.970753 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-c01c8d7f-9f96-483c-be6a-f5cffbfac8fe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.978284 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-00c0b8ea-7a5b-4c4d-9a94-bcc9cb288e3a tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd" status: 202 len: 0 microversion: 2.1 time: 0.195735 Jul 18 17:02:11.978867 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 550/1112] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 17:02:11 2022] DELETE /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:02:11.987949 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1d636b98-18da-4c9e-bda1-3491aa21f56a tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f5401550>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:12.035787 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1d636b98-18da-4c9e-bda1-3491aa21f56a tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd" status: 200 len: 345 microversion: 2.1 time: 0.051845 Jul 18 17:02:12.036270 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 551/1113] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 17:02:11 2022] GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:12.106395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-c01c8d7f-9f96-483c-be6a-f5cffbfac8fe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:12.114465 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-c01c8d7f-9f96-483c-be6a-f5cffbfac8fe tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1679 microversion: 2.1 time: 0.158072 Jul 18 17:02:12.115041 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 563/1114] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:11 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:13.048545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-646545c3-edaa-48d9-9640-e660cbd9ec18 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f5443790>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.081544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-646545c3-edaa-48d9-9640-e660cbd9ec18 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] HTTP exception thrown: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-646545c3-edaa-48d9-9640-e660cbd9ec18 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Request method failure captured: Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd HTTP/1.1 Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZILtHy4Ncy2PIF-3HuuIE-IXBrUrTg_LGdXC8DKLa2X_Z5c3pFRzejdCvpeWYIvlzOCdHn32wKdEcq-SOe6adxCRdUxr3F6iT171KoM5sV6PCBce4WqRA0L3G4XCHPa3xGJu3meBscAVcooh83fzx6Xep7K6gaoGxpQzY-yRlA_4hs Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: f0b6282ccd52404286aa7442e78e8086 Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:02:13.084957 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f0b6282ccd52404286aa7442e78e8086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f0b6282ccd52404286aa7442e78e8086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f0b6282ccd52404286aa7442e78e8086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f0b6282ccd52404286aa7442e78e8086"}]}] Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: f0b6282ccd52404286aa7442e78e8086 Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-VolumesSnapshotsTestJSON-1345517208-project Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 9c39b1e3315348799c5bd93c8b0535fd Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1345517208-project Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '55692830-da2b-426b-a411-e512561d94dd'} Jul 18 17:02:13.086480 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. (HTTP 404) (Request-ID: req-1bd7e50c-f209-46fe-acf1-6f8cca2210ad) Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.087360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 17:02:13.091346 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 17:02:13.094014 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-646545c3-edaa-48d9-9640-e660cbd9ec18 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Returning 404 to user: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:13.095545 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-646545c3-edaa-48d9-9640-e660cbd9ec18 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd" status: 404 len: 109 microversion: 2.1 time: 0.042773 Jul 18 17:02:13.100913 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 552/1115] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 17:02:13 2022] GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:13.105518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ad8a9666-2d22-4d84-b193-7ef96997b239 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f524f280>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.132008 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-8fe996f4-a4cc-4810-a698-ae855809bc8a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.134688 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-8fe996f4-a4cc-4810-a698-ae855809bc8a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:13.136781 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-ad8a9666-2d22-4d84-b193-7ef96997b239 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] HTTP exception thrown: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ad8a9666-2d22-4d84-b193-7ef96997b239 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Request method failure captured: Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd HTTP/1.1 Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZILtHy4Ncy2PIF-3HuuIE-IXBrUrTg_LGdXC8DKLa2X_Z5c3pFRzejdCvpeWYIvlzOCdHn32wKdEcq-SOe6adxCRdUxr3F6iT171KoM5sV6PCBce4WqRA0L3G4XCHPa3xGJu3meBscAVcooh83fzx6Xep7K6gaoGxpQzY-yRlA_4hs Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: f0b6282ccd52404286aa7442e78e8086 Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:02:13.138822 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f0b6282ccd52404286aa7442e78e8086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f0b6282ccd52404286aa7442e78e8086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f0b6282ccd52404286aa7442e78e8086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f0b6282ccd52404286aa7442e78e8086"}]}] Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: f0b6282ccd52404286aa7442e78e8086 Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesSnapshotsTestJSON-1345517208-project Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 9c39b1e3315348799c5bd93c8b0535fd Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1345517208-project Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '55692830-da2b-426b-a411-e512561d94dd'} Jul 18 17:02:13.140260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. (HTTP 404) (Request-ID: req-afc76ceb-c4d8-4d31-9e11-24d3bb2eb24b) Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.141607 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 17:02:13.143215 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 17:02:13.144603 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.146052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.146904 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8fe996f4-a4cc-4810-a698-ae855809bc8a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.147012 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ad8a9666-2d22-4d84-b193-7ef96997b239 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Returning 404 to user: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:13.147113 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8fe996f4-a4cc-4810-a698-ae855809bc8a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.147220 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ad8a9666-2d22-4d84-b193-7ef96997b239 tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd" status: 404 len: 109 microversion: 2.1 time: 0.041471 Jul 18 17:02:13.147320 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8fe996f4-a4cc-4810-a698-ae855809bc8a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.147416 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 564/1116] 10.222.0.88 () {58 vars in 1247 bytes} [Mon Jul 18 17:02:13 2022] DELETE /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:02:13.147514 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-8fe996f4-a4cc-4810-a698-ae855809bc8a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.152209 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f1e963d3-6b10-431f-b399-181ea7d3751e tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Calling method '.version_select at 0x7fd4f5195670>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.184044 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-f1e963d3-6b10-431f-b399-181ea7d3751e tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] HTTP exception thrown: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f1e963d3-6b10-431f-b399-181ea7d3751e tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Request method failure captured: Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd HTTP/1.1 Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZILtHy4Ncy2PIF-3HuuIE-IXBrUrTg_LGdXC8DKLa2X_Z5c3pFRzejdCvpeWYIvlzOCdHn32wKdEcq-SOe6adxCRdUxr3F6iT171KoM5sV6PCBce4WqRA0L3G4XCHPa3xGJu3meBscAVcooh83fzx6Xep7K6gaoGxpQzY-yRlA_4hs Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: f0b6282ccd52404286aa7442e78e8086 Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:02:13.186069 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f0b6282ccd52404286aa7442e78e8086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f0b6282ccd52404286aa7442e78e8086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f0b6282ccd52404286aa7442e78e8086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f0b6282ccd52404286aa7442e78e8086"}]}] Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: f0b6282ccd52404286aa7442e78e8086 Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1345517208 Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesSnapshotsTestJSON-1345517208-project Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 9c39b1e3315348799c5bd93c8b0535fd Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1345517208-project Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '55692830-da2b-426b-a411-e512561d94dd'} Jul 18 17:02:13.187716 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. (HTTP 404) (Request-ID: req-a0d6fe22-c763-4b25-adbe-f7bfe9d90a30) Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.188698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 17:02:13.190271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 17:02:13.191459 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f1e963d3-6b10-431f-b399-181ea7d3751e tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] Returning 404 to user: Volume 55692830-da2b-426b-a411-e512561d94dd could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f1e963d3-6b10-431f-b399-181ea7d3751e tempest-VolumesSnapshotsTestJSON-1345517208 tempest-VolumesSnapshotsTestJSON-1345517208-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd" status: 404 len: 109 microversion: 2.1 time: 0.039439 Jul 18 17:02:13.192830 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 565/1117] 10.222.0.88 () {58 vars in 1244 bytes} [Mon Jul 18 17:02:13 2022] GET /compute/v2.1/os-volumes/55692830-da2b-426b-a411-e512561d94dd => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:13.220530 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-8fe996f4-a4cc-4810-a698-ae855809bc8a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:13.228914 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-8fe996f4-a4cc-4810-a698-ae855809bc8a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1612 microversion: 2.1 time: 0.100896 Jul 18 17:02:13.235210 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 553/1118] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:13 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1612 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:13.412902 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-31339343-84cf-4863-ae98-4be98b2811a9 req-c8bee96b-6266-4689-8a17-7e3a962106e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008f8524-193f-493a-81b0-9d55d0a0e838", "name": "network-vif-deleted", "tag": "d72bc6fa-f304-455b-8dad-10c18eac6323"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:13.422760 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-31339343-84cf-4863-ae98-4be98b2811a9 req-c8bee96b-6266-4689-8a17-7e3a962106e0 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.423418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-31339343-84cf-4863-ae98-4be98b2811a9 req-c8bee96b-6266-4689-8a17-7e3a962106e0 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.439168 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-31339343-84cf-4863-ae98-4be98b2811a9 req-c8bee96b-6266-4689-8a17-7e3a962106e0 service nova] Creating event network-vif-deleted:d72bc6fa-f304-455b-8dad-10c18eac6323 for instance 008f8524-193f-493a-81b0-9d55d0a0e838 on hv-cinder-84617 Jul 18 17:02:13.445158 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-31339343-84cf-4863-ae98-4be98b2811a9 req-c8bee96b-6266-4689-8a17-7e3a962106e0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037789 Jul 18 17:02:13.449736 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 566/1119] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:14.247454 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:14.248081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:14.254540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.254993 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.255974 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.256413 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.299592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.300047 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.300540 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.objects.instance [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lazy-loading 'fault' on Instance uuid 008f8524-193f-493a-81b0-9d55d0a0e838 {{(pid=124754) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:02:14.346392 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '730d6426b4ee4cf38893fe2e60b97230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de8ee0667645a3864d846675d460e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:14.354104 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a980cac5-fab1-46a9-8000-64592a9f61a0 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 200 len: 1330 microversion: 2.1 time: 0.110748 Jul 18 17:02:14.354693 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 554/1120] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:14 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:15.371939 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:15.374168 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:15.380141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.380591 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.381448 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.381877 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.395711 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 HTTP/1.1 Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:02:15.397374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:15.399130 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '008f8524-193f-493a-81b0-9d55d0a0e838'} Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:15.400127 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:15.401772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:15.403109 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:15.403109 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cb2f4669-f51c-436b-b25b-3097c6878ab9 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 404 len: 111 microversion: 2.1 time: 0.031172 Jul 18 17:02:15.403109 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 567/1121] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:15 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:15.408719 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-659e5fb2-bc43-4886-add2-c179b182817c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '.version_select at 0x7fd4f53b4dc0>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:15.476546 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-659e5fb2-bc43-4886-add2-c179b182817c tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-21523698" status: 202 len: 0 microversion: 2.1 time: 0.072161 Jul 18 17:02:15.477183 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 555/1122] 10.222.0.88 () {58 vars in 1214 bytes} [Mon Jul 18 17:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-21523698 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:02:17.548759 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:17.549318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:17.555882 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.556331 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.557133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.557573 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.571826 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 HTTP/1.1 Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:02:17.573402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.575090 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '008f8524-193f-493a-81b0-9d55d0a0e838'} Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:17.576203 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.577598 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.579088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:17.579088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6bd0d5ec-59ca-4f98-8132-d07b1c24ab51 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 404 len: 111 microversion: 2.1 time: 0.030501 Jul 18 17:02:17.579088 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 568/1123] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:02:17 2022] DELETE /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:02:17.584068 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:17.584685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 008f8524-193f-493a-81b0-9d55d0a0e838] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:17.591698 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.592147 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.592936 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.593378 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.606464 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 HTTP/1.1 Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:02:17.608504 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.610157 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '008f8524-193f-493a-81b0-9d55d0a0e838'} Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:17.611083 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. Jul 18 17:02:17.612579 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:17.613946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 008f8524-193f-493a-81b0-9d55d0a0e838 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:17.613946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6325fd7f-df2b-479e-8e55-ab1cba9786c4 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838" status: 404 len: 111 microversion: 2.1 time: 0.030259 Jul 18 17:02:17.613946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 556/1124] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:17 2022] GET /compute/v2.1/servers/008f8524-193f-493a-81b0-9d55d0a0e838 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:18.824910 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:18.828966 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:18.833115 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.833605 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.834398 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.834833 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.848386 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 HTTP/1.1 Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:02:18.850057 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.851501 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '65181ed7-9c92-40b3-b38e-42adcd8d2f20'} Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:18.852270 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.853982 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.855588 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:18.855588 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2bc5185b-2648-44ac-a840-3ba26879ba62 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 404 len: 111 microversion: 2.1 time: 0.031423 Jul 18 17:02:18.855588 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 569/1125] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:02:18 2022] DELETE /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:18.862252 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:18.862860 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 65181ed7-9c92-40b3-b38e-42adcd8d2f20] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:18.869578 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.870024 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.870780 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.871249 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.885255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 HTTP/1.1 Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:02:18.886798 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.888738 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '65181ed7-9c92-40b3-b38e-42adcd8d2f20'} Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:18.889775 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. Jul 18 17:02:18.891389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.892715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 65181ed7-9c92-40b3-b38e-42adcd8d2f20 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:18.892715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a2c08749-6b28-476c-8651-70f62c06cb88 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20" status: 404 len: 111 microversion: 2.1 time: 0.030831 Jul 18 17:02:18.892715 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 557/1126] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:18 2022] GET /compute/v2.1/servers/65181ed7-9c92-40b3-b38e-42adcd8d2f20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:02:18.897594 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:18.898093 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:18.904422 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.904913 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.905695 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.906146 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.920618 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 HTTP/1.1 Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:02:18.922201 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.926121 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': 'c09f72cd-57c2-470c-b58b-60b79684a8d7'} Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:18.927661 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.928978 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.930370 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:18.930370 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-6ee8418b-569f-47ba-b070-75ef4635839a tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 404 len: 111 microversion: 2.1 time: 0.030151 Jul 18 17:02:18.930370 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 570/1127] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:02:18 2022] DELETE /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:18.932416 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:18.933066 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: c09f72cd-57c2-470c-b58b-60b79684a8d7] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:18.940131 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.940583 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.941394 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.941840 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.955458 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 HTTP/1.1 Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:02:18.957258 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.958973 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': 'c09f72cd-57c2-470c-b58b-60b79684a8d7'} Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:18.959769 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. Jul 18 17:02:18.961299 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:18.962739 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance c09f72cd-57c2-470c-b58b-60b79684a8d7 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:18.962739 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-53f8dfdf-d92e-49b4-9081-1d691edc4016 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7" status: 404 len: 111 microversion: 2.1 time: 0.030451 Jul 18 17:02:18.962739 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 558/1128] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:18 2022] GET /compute/v2.1/servers/c09f72cd-57c2-470c-b58b-60b79684a8d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:20.218860 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:20.219388 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:20.225916 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.231181 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.231181 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.231181 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: DELETE /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 HTTP/1.1 Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:02:20.248420 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.251170 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '2733168d-74ec-4dac-a804-6a9f03c2d409'} Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:20.252123 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.253657 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.255186 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:20.255186 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ef20ef64-0715-4a1b-93b0-df5000fe79ea tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 404 len: 111 microversion: 2.1 time: 0.030651 Jul 18 17:02:20.255186 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 571/1129] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:02:20 2022] DELETE /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:20.256902 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:20.257516 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] [instance: 2733168d-74ec-4dac-a804-6a9f03c2d409] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:20.264156 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.264607 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.265412 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.265853 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.281692 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] HTTP exception thrown: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Request method failure captured: Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 HTTP/1.1 Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZDeQLwh00Khg0C49kIqg-SGUJFAhFB39lihpXnZ1r7tbE0QJM7U37pI1TS56USaCms5dz-eXotIZwSl5kKIMmGgozSP1TDFlzv4q1MTXechRMsU16t5PjSYI_b-yRUbHPhpl9dN9dOtp3r-9unpb8bzK3ZE2unlLLBtsMfzXp_7PWs Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:02:20.283327 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/25de8ee0667645a3864d846675d460e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_25de8ee0667645a3864d846675d460e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/25de8ee0667645a3864d846675d460e1"}]}] Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 25de8ee0667645a3864d846675d460e1 Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959404958 Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 730d6426b4ee4cf38893fe2e60b97230 Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-AttachVolumeNegativeTest-1959404958-project Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.289488 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '2733168d-74ec-4dac-a804-6a9f03c2d409'} Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:02:20.290952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. Jul 18 17:02:20.292599 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:02:20.294000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] Returning 404 to user: Instance 2733168d-74ec-4dac-a804-6a9f03c2d409 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:02:20.294000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-2655119d-67ea-44be-ad98-291453caa987 tempest-AttachVolumeNegativeTest-1959404958 tempest-AttachVolumeNegativeTest-1959404958-project] 10.222.0.88 "GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409" status: 404 len: 111 microversion: 2.1 time: 0.031911 Jul 18 17:02:20.294000 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 559/1130] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:20 2022] GET /compute/v2.1/servers/2733168d-74ec-4dac-a804-6a9f03c2d409 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:48.196743 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1023183255", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "networks": [{"uuid": "7c5c00d7-ee79-466c-878c-a141c955e296"}]}} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:48.203752 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:48.204411 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:48.251579 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.network.neutron [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] validate_networks() for [('7c5c00d7-ee79-466c-878c-a141c955e296', None, None, None, None, None)] {{(pid=124753) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:02:48.659207 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Flavor limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:02:48.659637 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Image limits 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:02:48.660111 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Flavor pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:02:48.660545 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Image pref 0:0:0 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:02:48.660994 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.virt.hardware [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:02:48.670471 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:48.671028 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:48.674429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:48.674429 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:48.689869 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Getting quotas for project 18f27a3568f447279e227939696730bf. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:02:48.694418 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.quota [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Getting quotas for user 6daaa1076f054dd39fdf03017adb0d2f and project 18f27a3568f447279e227939696730bf. Resources: {'ram', 'cores', 'instances'} {{(pid=124753) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:02:48.705842 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Going to run 1 instances... {{(pid=124753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:02:48.708803 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:02:48.802624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-bc37ee43-7173-45f6-a089-1a58f1f9fb2d tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609693 Jul 18 17:02:48.803272 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 572/1131] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 17:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:02:48.813364 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-11560780-fcb7-49da-a9d2-3b04b2ec723c tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:48.818242 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-11560780-fcb7-49da-a9d2-3b04b2ec723c tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:48.818242 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:48.818242 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=51 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:48.898424 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-11560780-fcb7-49da-a9d2-3b04b2ec723c tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:48.905574 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-11560780-fcb7-49da-a9d2-3b04b2ec723c tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1214 microversion: 2.1 time: 0.096214 Jul 18 17:02:48.906462 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 560/1132] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:48 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:49.924649 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-e9c8bd31-b8f7-463a-bc91-d0f8a59c848b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:49.930748 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-e9c8bd31-b8f7-463a-bc91-d0f8a59c848b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:49.991141 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-e9c8bd31-b8f7-463a-bc91-d0f8a59c848b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:49.998840 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-e9c8bd31-b8f7-463a-bc91-d0f8a59c848b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1214 microversion: 2.1 time: 0.079019 Jul 18 17:02:49.999402 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 573/1133] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:49 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:51.015966 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e3185486-1069-4bac-abe4-4bd2b77f5dd0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:51.016720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e3185486-1069-4bac-abe4-4bd2b77f5dd0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:51.024391 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e3185486-1069-4bac-abe4-4bd2b77f5dd0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:51.024841 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e3185486-1069-4bac-abe4-4bd2b77f5dd0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:51.025659 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e3185486-1069-4bac-abe4-4bd2b77f5dd0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:51.026100 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e3185486-1069-4bac-abe4-4bd2b77f5dd0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:51.094675 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e3185486-1069-4bac-abe4-4bd2b77f5dd0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:51.103382 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e3185486-1069-4bac-abe4-4bd2b77f5dd0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1266 microversion: 2.1 time: 0.091235 Jul 18 17:02:51.104038 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 561/1134] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:51 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:52.121405 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-054719a9-1dae-4a80-bc95-29f103f9708e tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:52.122114 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-054719a9-1dae-4a80-bc95-29f103f9708e tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:52.129814 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-054719a9-1dae-4a80-bc95-29f103f9708e tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:52.130395 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-054719a9-1dae-4a80-bc95-29f103f9708e tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:52.131174 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-054719a9-1dae-4a80-bc95-29f103f9708e tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:52.131620 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-054719a9-1dae-4a80-bc95-29f103f9708e tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:52.264202 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-054719a9-1dae-4a80-bc95-29f103f9708e tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:52.272732 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-054719a9-1dae-4a80-bc95-29f103f9708e tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.155363 Jul 18 17:02:52.273461 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 574/1135] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:52 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:53.052225 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-a2cd8b2a-3863-458f-a5d6-f455e8c7742f req-1cdd8772-e62f-45ba-8b67-148667ab0238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31194e4f-c892-4ed6-aaf2-8486e054b485", "tag": "82b936ef-3736-41ce-b6d5-13c3fe5dc654"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:53.062115 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-a2cd8b2a-3863-458f-a5d6-f455e8c7742f req-1cdd8772-e62f-45ba-8b67-148667ab0238 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:53.062664 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-a2cd8b2a-3863-458f-a5d6-f455e8c7742f req-1cdd8772-e62f-45ba-8b67-148667ab0238 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:53.075092 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-a2cd8b2a-3863-458f-a5d6-f455e8c7742f req-1cdd8772-e62f-45ba-8b67-148667ab0238 service nova] Creating event network-changed:82b936ef-3736-41ce-b6d5-13c3fe5dc654 for instance 31194e4f-c892-4ed6-aaf2-8486e054b485 on hv-cinder-84617 Jul 18 17:02:53.080233 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-a2cd8b2a-3863-458f-a5d6-f455e8c7742f req-1cdd8772-e62f-45ba-8b67-148667ab0238 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033740 Jul 18 17:02:53.081108 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 562/1136] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:53.290035 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-1486a9b5-a8c5-43b8-bdca-81e3e2ee2878 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:53.294364 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-1486a9b5-a8c5-43b8-bdca-81e3e2ee2878 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:53.297811 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1486a9b5-a8c5-43b8-bdca-81e3e2ee2878 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:53.298275 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1486a9b5-a8c5-43b8-bdca-81e3e2ee2878 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:53.299074 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1486a9b5-a8c5-43b8-bdca-81e3e2ee2878 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:53.299502 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-1486a9b5-a8c5-43b8-bdca-81e3e2ee2878 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:53.437227 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-1486a9b5-a8c5-43b8-bdca-81e3e2ee2878 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:53.445747 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-1486a9b5-a8c5-43b8-bdca-81e3e2ee2878 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.159714 Jul 18 17:02:53.446318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 575/1137] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:53 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:54.464020 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-42b07178-08d5-4033-b8e7-f5b4471593cc tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:54.464721 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-42b07178-08d5-4033-b8e7-f5b4471593cc tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:54.471448 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42b07178-08d5-4033-b8e7-f5b4471593cc tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:54.472527 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42b07178-08d5-4033-b8e7-f5b4471593cc tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:54.473323 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42b07178-08d5-4033-b8e7-f5b4471593cc tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:54.473767 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-42b07178-08d5-4033-b8e7-f5b4471593cc tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:54.864539 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-42b07178-08d5-4033-b8e7-f5b4471593cc tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:54.872158 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-42b07178-08d5-4033-b8e7-f5b4471593cc tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.412276 Jul 18 17:02:54.872717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 563/1138] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:54 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:55.888929 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-143e8f95-ba60-425a-bf76-b8822c2c26cb tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:55.889583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-143e8f95-ba60-425a-bf76-b8822c2c26cb tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:55.896552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-143e8f95-ba60-425a-bf76-b8822c2c26cb tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:55.897037 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-143e8f95-ba60-425a-bf76-b8822c2c26cb tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:55.897841 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-143e8f95-ba60-425a-bf76-b8822c2c26cb tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:55.898260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-143e8f95-ba60-425a-bf76-b8822c2c26cb tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.031582 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-143e8f95-ba60-425a-bf76-b8822c2c26cb tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:56.039728 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-143e8f95-ba60-425a-bf76-b8822c2c26cb tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.154703 Jul 18 17:02:56.040337 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 576/1139] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:55 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:57.057187 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-937550f5-a2ba-4246-9ac6-5e43d6246be6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:57.057794 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-937550f5-a2ba-4246-9ac6-5e43d6246be6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:57.064793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-937550f5-a2ba-4246-9ac6-5e43d6246be6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:57.065268 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-937550f5-a2ba-4246-9ac6-5e43d6246be6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:57.066038 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-937550f5-a2ba-4246-9ac6-5e43d6246be6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:57.066465 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-937550f5-a2ba-4246-9ac6-5e43d6246be6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:57.212531 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-937550f5-a2ba-4246-9ac6-5e43d6246be6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:57.220006 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-937550f5-a2ba-4246-9ac6-5e43d6246be6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.166739 Jul 18 17:02:57.220582 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 564/1140] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:57 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:58.237452 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-698062e6-62a5-4bd6-8911-82d325d5f2f4 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:58.238142 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-698062e6-62a5-4bd6-8911-82d325d5f2f4 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:58.244867 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-698062e6-62a5-4bd6-8911-82d325d5f2f4 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:58.245374 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-698062e6-62a5-4bd6-8911-82d325d5f2f4 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.246156 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-698062e6-62a5-4bd6-8911-82d325d5f2f4 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:58.246602 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-698062e6-62a5-4bd6-8911-82d325d5f2f4 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.382917 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-698062e6-62a5-4bd6-8911-82d325d5f2f4 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:58.390349 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-698062e6-62a5-4bd6-8911-82d325d5f2f4 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.156947 Jul 18 17:02:58.390918 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 577/1141] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:58 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:59.409081 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e4c9a533-c283-4a5a-8cbb-2fbe8b76fab9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:59.409640 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e4c9a533-c283-4a5a-8cbb-2fbe8b76fab9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:59.412548 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:59.418927 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e4c9a533-c283-4a5a-8cbb-2fbe8b76fab9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:59.418927 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e4c9a533-c283-4a5a-8cbb-2fbe8b76fab9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:59.418927 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e4c9a533-c283-4a5a-8cbb-2fbe8b76fab9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:59.419408 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e4c9a533-c283-4a5a-8cbb-2fbe8b76fab9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:59.565621 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e4c9a533-c283-4a5a-8cbb-2fbe8b76fab9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:59.573567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e4c9a533-c283-4a5a-8cbb-2fbe8b76fab9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.169350 Jul 18 17:02:59.574160 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 565/1142] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:59 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:00.594306 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4ee450b8-ef85-49a8-845c-2dceb981b854 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:00.594924 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4ee450b8-ef85-49a8-845c-2dceb981b854 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:00.600369 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:00.601519 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=8 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:00.603704 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4ee450b8-ef85-49a8-845c-2dceb981b854 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:00.604159 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4ee450b8-ef85-49a8-845c-2dceb981b854 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:00.604969 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4ee450b8-ef85-49a8-845c-2dceb981b854 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:00.605415 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-4ee450b8-ef85-49a8-845c-2dceb981b854 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:00.739789 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4ee450b8-ef85-49a8-845c-2dceb981b854 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:00.747260 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4ee450b8-ef85-49a8-845c-2dceb981b854 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.156958 Jul 18 17:03:00.747826 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 578/1143] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:00 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:01.764077 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e56f6137-e82c-4090-8820-065c031513a9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:01.764785 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e56f6137-e82c-4090-8820-065c031513a9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:01.771371 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e56f6137-e82c-4090-8820-065c031513a9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.771900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e56f6137-e82c-4090-8820-065c031513a9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.772684 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e56f6137-e82c-4090-8820-065c031513a9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.773153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e56f6137-e82c-4090-8820-065c031513a9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.904484 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e56f6137-e82c-4090-8820-065c031513a9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:01.912606 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e56f6137-e82c-4090-8820-065c031513a9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.152367 Jul 18 17:03:01.913222 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 566/1144] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:01 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:02.199725 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-b33b4cc1-d78c-4ae1-99bc-810a7a40df47 req-a63777ab-a419-4ef6-8346-8f2d44ed7f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31194e4f-c892-4ed6-aaf2-8486e054b485", "name": "network-vif-plugged", "status": "completed", "tag": "82b936ef-3736-41ce-b6d5-13c3fe5dc654"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:02.208624 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-b33b4cc1-d78c-4ae1-99bc-810a7a40df47 req-a63777ab-a419-4ef6-8346-8f2d44ed7f1c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.209152 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-b33b4cc1-d78c-4ae1-99bc-810a7a40df47 req-a63777ab-a419-4ef6-8346-8f2d44ed7f1c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:02.220608 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-b33b4cc1-d78c-4ae1-99bc-810a7a40df47 req-a63777ab-a419-4ef6-8346-8f2d44ed7f1c service nova] Creating event network-vif-plugged:82b936ef-3736-41ce-b6d5-13c3fe5dc654 for instance 31194e4f-c892-4ed6-aaf2-8486e054b485 on hv-cinder-84617 Jul 18 17:03:02.226617 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-b33b4cc1-d78c-4ae1-99bc-810a7a40df47 req-a63777ab-a419-4ef6-8346-8f2d44ed7f1c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229645 Jul 18 17:03:02.227225 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 579/1145] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:02.928873 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ef941d91-f8fc-4609-b5a0-0bfcf9badc55 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:02.929592 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ef941d91-f8fc-4609-b5a0-0bfcf9badc55 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:02.937061 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ef941d91-f8fc-4609-b5a0-0bfcf9badc55 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.937507 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ef941d91-f8fc-4609-b5a0-0bfcf9badc55 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:02.938273 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ef941d91-f8fc-4609-b5a0-0bfcf9badc55 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.938972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ef941d91-f8fc-4609-b5a0-0bfcf9badc55 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:03.087597 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ef941d91-f8fc-4609-b5a0-0bfcf9badc55 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:03.096178 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ef941d91-f8fc-4609-b5a0-0bfcf9badc55 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1314 microversion: 2.1 time: 0.171100 Jul 18 17:03:03.097329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 567/1146] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:02 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:04.115182 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-7221d3f2-5a7f-4cad-96ea-3e17188f2926 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:04.115903 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-7221d3f2-5a7f-4cad-96ea-3e17188f2926 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:04.122564 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7221d3f2-5a7f-4cad-96ea-3e17188f2926 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:04.123010 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7221d3f2-5a7f-4cad-96ea-3e17188f2926 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:04.123774 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7221d3f2-5a7f-4cad-96ea-3e17188f2926 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:04.124205 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-7221d3f2-5a7f-4cad-96ea-3e17188f2926 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:04.253856 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-7221d3f2-5a7f-4cad-96ea-3e17188f2926 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:04.262083 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-7221d3f2-5a7f-4cad-96ea-3e17188f2926 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1497 microversion: 2.1 time: 0.151625 Jul 18 17:03:04.262711 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 580/1147] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:04 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:05.186932 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ddd45afe-4a75-4b21-b9ef-b6c15d6177ca tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:05.187499 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ddd45afe-4a75-4b21-b9ef-b6c15d6177ca tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:05.194280 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddd45afe-4a75-4b21-b9ef-b6c15d6177ca tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.194728 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddd45afe-4a75-4b21-b9ef-b6c15d6177ca tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.195491 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddd45afe-4a75-4b21-b9ef-b6c15d6177ca tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.195929 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ddd45afe-4a75-4b21-b9ef-b6c15d6177ca tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.224519 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ddd45afe-4a75-4b21-b9ef-b6c15d6177ca tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Going to try to terminate instance {{(pid=124754) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:03:05.617863 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ddd45afe-4a75-4b21-b9ef-b6c15d6177ca tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "DELETE /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 204 len: 0 microversion: 2.1 time: 0.434446 Jul 18 17:03:05.618462 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 568/1148] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:03:05 2022] DELETE /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:03:05.626635 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-ecc8df6c-501a-47c4-ac8f-37deb14860ba tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:05.627243 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-ecc8df6c-501a-47c4-ac8f-37deb14860ba tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:05.633742 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ecc8df6c-501a-47c4-ac8f-37deb14860ba tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.634190 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ecc8df6c-501a-47c4-ac8f-37deb14860ba tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.634977 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ecc8df6c-501a-47c4-ac8f-37deb14860ba tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.635403 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-ecc8df6c-501a-47c4-ac8f-37deb14860ba tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.769583 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-ecc8df6c-501a-47c4-ac8f-37deb14860ba tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:05.777739 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-ecc8df6c-501a-47c4-ac8f-37deb14860ba tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1503 microversion: 2.1 time: 0.154973 Jul 18 17:03:05.778318 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 581/1149] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:05 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:06.796491 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-5400ee29-95d8-47fc-a0a9-17769ceadc65 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:06.797399 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-5400ee29-95d8-47fc-a0a9-17769ceadc65 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:06.804544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5400ee29-95d8-47fc-a0a9-17769ceadc65 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.805019 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5400ee29-95d8-47fc-a0a9-17769ceadc65 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.805788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5400ee29-95d8-47fc-a0a9-17769ceadc65 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.806220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-5400ee29-95d8-47fc-a0a9-17769ceadc65 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.940179 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-5400ee29-95d8-47fc-a0a9-17769ceadc65 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:06.948054 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-5400ee29-95d8-47fc-a0a9-17769ceadc65 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1503 microversion: 2.1 time: 0.156165 Jul 18 17:03:06.948625 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 569/1150] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:06 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:07.704255 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-ff9655f3-1205-4c2d-9458-7567534ab258 req-5e88e0fd-5486-4283-916f-eb4ff17bbb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31194e4f-c892-4ed6-aaf2-8486e054b485", "name": "network-vif-deleted", "tag": "82b936ef-3736-41ce-b6d5-13c3fe5dc654"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:07.713894 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-ff9655f3-1205-4c2d-9458-7567534ab258 req-5e88e0fd-5486-4283-916f-eb4ff17bbb3c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.714408 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-ff9655f3-1205-4c2d-9458-7567534ab258 req-5e88e0fd-5486-4283-916f-eb4ff17bbb3c service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:07.728195 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-ff9655f3-1205-4c2d-9458-7567534ab258 req-5e88e0fd-5486-4283-916f-eb4ff17bbb3c service nova] Creating event network-vif-deleted:82b936ef-3736-41ce-b6d5-13c3fe5dc654 for instance 31194e4f-c892-4ed6-aaf2-8486e054b485 on hv-cinder-84617 Jul 18 17:03:07.734871 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-ff9655f3-1205-4c2d-9458-7567534ab258 req-5e88e0fd-5486-4283-916f-eb4ff17bbb3c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034227 Jul 18 17:03:07.735515 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 582/1151] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:07.965977 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-6d622c21-68ac-46e6-9fb2-82a5660f6361 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:07.966587 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-6d622c21-68ac-46e6-9fb2-82a5660f6361 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:07.973385 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d622c21-68ac-46e6-9fb2-82a5660f6361 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.973835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d622c21-68ac-46e6-9fb2-82a5660f6361 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:07.974616 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d622c21-68ac-46e6-9fb2-82a5660f6361 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.975064 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-6d622c21-68ac-46e6-9fb2-82a5660f6361 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:08.042788 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-6d622c21-68ac-46e6-9fb2-82a5660f6361 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:08.051860 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-6d622c21-68ac-46e6-9fb2-82a5660f6361 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 200 len: 1299 microversion: 2.1 time: 0.089378 Jul 18 17:03:08.052447 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 570/1152] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:07 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:09.070619 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:09.071331 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 31194e4f-c892-4ed6-aaf2-8486e054b485] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:09.077493 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:09.077972 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:09.078730 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:09.079164 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:09.095055 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.wsgi [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] HTTP exception thrown: Instance 31194e4f-c892-4ed6-aaf2-8486e054b485 could not be found. Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Request method failure captured: Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: request: GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 HTTP/1.1 Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept: application/json Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Accept-Encoding: identity Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Connection: close Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Length: 0 Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Content-Type: application/json Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Host: 10.222.0.88 Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Openstack-System-Scope: None Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Auth-Token: gAAAAABi1ZI1tOy_7i-KMXhELmhBXFIh9S2O5cbrzi0DxxV6wgzu4c8Oh0ysmy_9OKCpY-yiEn5SzjSuZijDtbIVH4YP4YpU7J7n50HpkQiftPW6p1C099ila1hb0v2LbjFZ1Wk8C7EHHR7ti2nuw42uctW9ckJRpBr-Sc9A9Mhf6VfzAJaaslQ Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Id: None Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Domain-Name: None Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Identity-Status: Confirmed Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Is-Admin-Project: True Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Id: default Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Domain-Name: Default Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Id: 18f27a3568f447279e227939696730bf Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Project-Name: tempest-VolumesActionsTest-353179771 Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Role: member,reader Jul 18 17:03:09.096675 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Roles: member,reader Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/18f27a3568f447279e227939696730bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/18f27a3568f447279e227939696730bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_18f27a3568f447279e227939696730bf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/18f27a3568f447279e227939696730bf"}]}] Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant: tempest-VolumesActionsTest-353179771 Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Id: 18f27a3568f447279e227939696730bf Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-Tenant-Name: tempest-VolumesActionsTest-353179771 Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User: tempest-VolumesActionsTest-353179771-project Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Id: default Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Domain-Name: Default Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Id: 6daaa1076f054dd39fdf03017adb0d2f Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: X-User-Name: tempest-VolumesActionsTest-353179771-project Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: method: > Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: exception: Instance 31194e4f-c892-4ed6-aaf2-8486e054b485 could not be found. Jul 18 17:03:09.098481 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: action_args: {'id': '31194e4f-c892-4ed6-aaf2-8486e054b485'} Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31194e4f-c892-4ed6-aaf2-8486e054b485 could not be found. Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:09.099530 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31194e4f-c892-4ed6-aaf2-8486e054b485 could not be found. Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31194e4f-c892-4ed6-aaf2-8486e054b485 could not be found. Jul 18 17:03:09.101218 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: ERROR nova.api.openstack.wsgi Jul 18 17:03:09.102950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Returning 404 to user: Instance 31194e4f-c892-4ed6-aaf2-8486e054b485 could not be found. {{(pid=124753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:09.102950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2e3a1414-8642-4a3b-bf9a-9cdfa00b4b09 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485" status: 404 len: 111 microversion: 2.1 time: 0.032793 Jul 18 17:03:09.102950 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 583/1153] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:09 2022] GET /compute/v2.1/servers/31194e4f-c892-4ed6-aaf2-8486e054b485 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:03:09.196634 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1076091772", "imageRef": "b72ce9f8-d850-4319-ac46-b4d2964bee06", "flavorRef": "452", "networks": [{"uuid": "7c5c00d7-ee79-466c-878c-a141c955e296"}]}} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:09.249124 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.network.neutron [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] validate_networks() for [('7c5c00d7-ee79-466c-878c-a141c955e296', None, None, None, None, None)] {{(pid=124754) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:03:09.706244 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Flavor limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:03:09.706670 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Image limits 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:03:09.707144 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Flavor pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:03:09.707555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Image pref 0:0:0 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:03:09.707972 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.virt.hardware [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124754) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:03:09.717084 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:09.717535 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:09.718345 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:09.718793 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:09.736123 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Getting quotas for project 18f27a3568f447279e227939696730bf. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:03:09.741746 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.quota [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Getting quotas for user 6daaa1076f054dd39fdf03017adb0d2f and project 18f27a3568f447279e227939696730bf. Resources: {'ram', 'cores', 'instances'} {{(pid=124754) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:03:09.757547 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Going to run 1 instances... {{(pid=124754) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:03:09.759873 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72ce9f8-d850-4319-ac46-b4d2964bee06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124754) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:03:09.883219 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-a53e215d-cef3-4627-8595-a1455eab8c98 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690041 Jul 18 17:03:09.884082 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 571/1154] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 18 17:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:03:09.894276 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-4a3990d1-7fc0-4535-abfb-49dcea539c64 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:09.895263 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-4a3990d1-7fc0-4535-abfb-49dcea539c64 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:09.956100 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-4a3990d1-7fc0-4535-abfb-49dcea539c64 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:09.963482 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-4a3990d1-7fc0-4535-abfb-49dcea539c64 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1214 microversion: 2.1 time: 0.073092 Jul 18 17:03:09.964139 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 584/1155] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:09 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:10.981360 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-e352837c-612e-4790-8230-269a19752f37 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:10.981975 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-e352837c-612e-4790-8230-269a19752f37 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:10.989116 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e352837c-612e-4790-8230-269a19752f37 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:10.989573 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e352837c-612e-4790-8230-269a19752f37 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:10.990341 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e352837c-612e-4790-8230-269a19752f37 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:10.990778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-e352837c-612e-4790-8230-269a19752f37 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:11.052475 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-e352837c-612e-4790-8230-269a19752f37 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:11.060018 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-e352837c-612e-4790-8230-269a19752f37 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1218 microversion: 2.1 time: 0.082577 Jul 18 17:03:11.060596 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 572/1156] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:10 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:12.078000 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-315d0bae-9cb1-4a97-94d7-4bfb06230b25 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:12.078615 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-315d0bae-9cb1-4a97-94d7-4bfb06230b25 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:12.086897 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-315d0bae-9cb1-4a97-94d7-4bfb06230b25 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:12.091878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-315d0bae-9cb1-4a97-94d7-4bfb06230b25 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:12.091878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-315d0bae-9cb1-4a97-94d7-4bfb06230b25 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:12.091878 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-315d0bae-9cb1-4a97-94d7-4bfb06230b25 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:12.166392 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-315d0bae-9cb1-4a97-94d7-4bfb06230b25 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:12.174640 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-315d0bae-9cb1-4a97-94d7-4bfb06230b25 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1274 microversion: 2.1 time: 0.100399 Jul 18 17:03:12.175493 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 585/1157] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:12 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:13.193315 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-52cc9a6d-790c-4d43-83f0-98267cc222f0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:13.193904 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-52cc9a6d-790c-4d43-83f0-98267cc222f0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:13.200765 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-52cc9a6d-790c-4d43-83f0-98267cc222f0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:13.201243 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-52cc9a6d-790c-4d43-83f0-98267cc222f0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:13.202009 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-52cc9a6d-790c-4d43-83f0-98267cc222f0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:13.202438 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-52cc9a6d-790c-4d43-83f0-98267cc222f0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:13.412009 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-52cc9a6d-790c-4d43-83f0-98267cc222f0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:13.419886 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-52cc9a6d-790c-4d43-83f0-98267cc222f0 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1314 microversion: 2.1 time: 0.231367 Jul 18 17:03:13.420611 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 573/1158] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:13 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:13.869072 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-efa28ce2-e16f-40c5-a401-0a054d13a305 req-137e9794-5ece-413b-a4fe-76ebc3a707b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a653fe-0bb9-4be6-9aaa-2cbc885142b3", "tag": "b01a1653-b96b-4093-b540-b0783b8f34d2"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:13.877636 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-efa28ce2-e16f-40c5-a401-0a054d13a305 req-137e9794-5ece-413b-a4fe-76ebc3a707b4 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:13.884154 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-efa28ce2-e16f-40c5-a401-0a054d13a305 req-137e9794-5ece-413b-a4fe-76ebc3a707b4 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:13.900791 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-efa28ce2-e16f-40c5-a401-0a054d13a305 req-137e9794-5ece-413b-a4fe-76ebc3a707b4 service nova] Creating event network-changed:b01a1653-b96b-4093-b540-b0783b8f34d2 for instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 on hv-cinder-84617 Jul 18 17:03:13.905932 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-efa28ce2-e16f-40c5-a401-0a054d13a305 req-137e9794-5ece-413b-a4fe-76ebc3a707b4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040917 Jul 18 17:03:13.906615 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 586/1159] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:14.437225 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-9a72349f-12be-45e3-a5e9-e87ed3511c07 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:14.437978 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-9a72349f-12be-45e3-a5e9-e87ed3511c07 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:14.444831 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9a72349f-12be-45e3-a5e9-e87ed3511c07 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:14.445322 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9a72349f-12be-45e3-a5e9-e87ed3511c07 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:14.446097 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9a72349f-12be-45e3-a5e9-e87ed3511c07 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:14.446533 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-9a72349f-12be-45e3-a5e9-e87ed3511c07 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:14.655021 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-9a72349f-12be-45e3-a5e9-e87ed3511c07 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:14.663096 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-9a72349f-12be-45e3-a5e9-e87ed3511c07 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1314 microversion: 2.1 time: 0.229713 Jul 18 17:03:14.663681 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 574/1160] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:14 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:15.681360 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-68462761-b8fe-44fb-bb83-ad93bf6d2099 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:15.682052 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-68462761-b8fe-44fb-bb83-ad93bf6d2099 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:15.688552 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68462761-b8fe-44fb-bb83-ad93bf6d2099 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:15.689043 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68462761-b8fe-44fb-bb83-ad93bf6d2099 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:15.689796 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68462761-b8fe-44fb-bb83-ad93bf6d2099 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:15.690237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-68462761-b8fe-44fb-bb83-ad93bf6d2099 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:15.825698 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-68462761-b8fe-44fb-bb83-ad93bf6d2099 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:15.833159 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-68462761-b8fe-44fb-bb83-ad93bf6d2099 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1314 microversion: 2.1 time: 0.157128 Jul 18 17:03:15.833738 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 587/1161] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:15 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:16.850335 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-b2c959cb-e816-4bf0-96d0-6a4b0a516ba9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:16.850932 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-b2c959cb-e816-4bf0-96d0-6a4b0a516ba9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:16.857153 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b2c959cb-e816-4bf0-96d0-6a4b0a516ba9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:16.857597 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b2c959cb-e816-4bf0-96d0-6a4b0a516ba9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:16.858348 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b2c959cb-e816-4bf0-96d0-6a4b0a516ba9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:16.858778 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-b2c959cb-e816-4bf0-96d0-6a4b0a516ba9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:16.987544 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-b2c959cb-e816-4bf0-96d0-6a4b0a516ba9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:16.994982 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-b2c959cb-e816-4bf0-96d0-6a4b0a516ba9 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1314 microversion: 2.1 time: 0.149100 Jul 18 17:03:16.995567 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 575/1162] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:16 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:18.011844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-9db88f40-25ff-4c59-a45b-59cbdec75ad5 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:18.012570 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-9db88f40-25ff-4c59-a45b-59cbdec75ad5 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:18.019439 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9db88f40-25ff-4c59-a45b-59cbdec75ad5 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:18.021580 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9db88f40-25ff-4c59-a45b-59cbdec75ad5 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:18.021580 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9db88f40-25ff-4c59-a45b-59cbdec75ad5 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:18.021580 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-9db88f40-25ff-4c59-a45b-59cbdec75ad5 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:18.152291 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-9db88f40-25ff-4c59-a45b-59cbdec75ad5 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:18.159711 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-9db88f40-25ff-4c59-a45b-59cbdec75ad5 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1314 microversion: 2.1 time: 0.151928 Jul 18 17:03:18.160287 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 588/1163] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:18 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:19.176179 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-1a1cddde-2318-42af-b3b4-0a75e24e6f11 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:19.176771 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-1a1cddde-2318-42af-b3b4-0a75e24e6f11 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:19.183521 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1a1cddde-2318-42af-b3b4-0a75e24e6f11 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:19.183899 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1a1cddde-2318-42af-b3b4-0a75e24e6f11 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:19.184794 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1a1cddde-2318-42af-b3b4-0a75e24e6f11 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:19.185604 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-1a1cddde-2318-42af-b3b4-0a75e24e6f11 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:19.188589 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:19.322826 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-1a1cddde-2318-42af-b3b4-0a75e24e6f11 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:19.334220 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-1a1cddde-2318-42af-b3b4-0a75e24e6f11 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1314 microversion: 2.1 time: 0.161794 Jul 18 17:03:19.334808 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 576/1164] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:19 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:20.172873 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [req-fed7550c-62e6-4620-b69b-0ff00aa62946 req-cc0de6a0-3e76-4dd9-a4a7-eec92cca2944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a653fe-0bb9-4be6-9aaa-2cbc885142b3", "name": "network-vif-plugged", "status": "completed", "tag": "b01a1653-b96b-4093-b540-b0783b8f34d2"}]} {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:20.176973 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell0:SELECT=2 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:20.177639 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:20.182850 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-fed7550c-62e6-4620-b69b-0ff00aa62946 req-cc0de6a0-3e76-4dd9-a4a7-eec92cca2944 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:20.183236 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [req-fed7550c-62e6-4620-b69b-0ff00aa62946 req-cc0de6a0-3e76-4dd9-a4a7-eec92cca2944 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:20.185976 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG dbcounter [-] [124753] Writing DB stats nova_cell1:SELECT=71 {{(pid=124753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:20.195687 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.compute.server_external_events [req-fed7550c-62e6-4620-b69b-0ff00aa62946 req-cc0de6a0-3e76-4dd9-a4a7-eec92cca2944 service nova] Creating event network-vif-plugged:b01a1653-b96b-4093-b540-b0783b8f34d2 for instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 on hv-cinder-84617 Jul 18 17:03:20.200620 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [req-fed7550c-62e6-4620-b69b-0ff00aa62946 req-cc0de6a0-3e76-4dd9-a4a7-eec92cca2944 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031468 Jul 18 17:03:20.201237 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 589/1165] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:20.351373 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-ff0174b0-0c74-44b9-967a-b5bca23c19c6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:20.352207 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-ff0174b0-0c74-44b9-967a-b5bca23c19c6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:20.353832 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=2 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:20.354474 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_cell0:SELECT=6 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:20.359944 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff0174b0-0c74-44b9-967a-b5bca23c19c6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:20.360389 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff0174b0-0c74-44b9-967a-b5bca23c19c6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:20.361181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff0174b0-0c74-44b9-967a-b5bca23c19c6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:20.361619 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-ff0174b0-0c74-44b9-967a-b5bca23c19c6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:20.496211 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-ff0174b0-0c74-44b9-967a-b5bca23c19c6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:20.503720 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-ff0174b0-0c74-44b9-967a-b5bca23c19c6 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1314 microversion: 2.1 time: 0.157189 Jul 18 17:03:20.507436 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 577/1166] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:20 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:21.521177 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-788c4cfa-8e13-48aa-81a5-6c0677cb2641 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:21.521886 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-788c4cfa-8e13-48aa-81a5-6c0677cb2641 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:21.529520 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-788c4cfa-8e13-48aa-81a5-6c0677cb2641 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:21.529974 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-788c4cfa-8e13-48aa-81a5-6c0677cb2641 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:21.530793 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-788c4cfa-8e13-48aa-81a5-6c0677cb2641 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:21.531241 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-788c4cfa-8e13-48aa-81a5-6c0677cb2641 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:21.666376 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-788c4cfa-8e13-48aa-81a5-6c0677cb2641 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:21.673864 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-788c4cfa-8e13-48aa-81a5-6c0677cb2641 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1314 microversion: 2.1 time: 0.158010 Jul 18 17:03:21.674440 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 590/1167] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:21 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:22.692362 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-841408c2-3d65-44a7-9be8-0a367df0071b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:22.692999 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-841408c2-3d65-44a7-9be8-0a367df0071b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:22.695255 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG dbcounter [-] [124754] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:22.700804 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-841408c2-3d65-44a7-9be8-0a367df0071b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:22.701397 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-841408c2-3d65-44a7-9be8-0a367df0071b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:22.702714 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-841408c2-3d65-44a7-9be8-0a367df0071b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:22.702882 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-841408c2-3d65-44a7-9be8-0a367df0071b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:22.844028 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-841408c2-3d65-44a7-9be8-0a367df0071b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:22.852354 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-841408c2-3d65-44a7-9be8-0a367df0071b tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1497 microversion: 2.1 time: 0.165281 Jul 18 17:03:22.852952 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 578/1168] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:22 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:23.715322 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-2513b9f8-4897-4acc-9bf3-5702aa90179f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:23.716020 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2513b9f8-4897-4acc-9bf3-5702aa90179f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:23.722533 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2513b9f8-4897-4acc-9bf3-5702aa90179f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:23.722988 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2513b9f8-4897-4acc-9bf3-5702aa90179f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:23.724329 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2513b9f8-4897-4acc-9bf3-5702aa90179f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:23.724772 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-2513b9f8-4897-4acc-9bf3-5702aa90179f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:23.752017 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-2513b9f8-4897-4acc-9bf3-5702aa90179f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Going to try to terminate instance {{(pid=124753) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:03:24.057504 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-2513b9f8-4897-4acc-9bf3-5702aa90179f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "DELETE /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 204 len: 0 microversion: 2.1 time: 0.345763 Jul 18 17:03:24.058468 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 591/1169] 10.222.0.88 () {58 vars in 1238 bytes} [Mon Jul 18 17:03:23 2022] DELETE /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:03:24.070071 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-97064ecb-b17f-417b-ab74-3f584959bb3f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:24.070685 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-97064ecb-b17f-417b-ab74-3f584959bb3f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:24.077277 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-97064ecb-b17f-417b-ab74-3f584959bb3f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:24.077726 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-97064ecb-b17f-417b-ab74-3f584959bb3f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:24.078495 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-97064ecb-b17f-417b-ab74-3f584959bb3f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:24.078934 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-97064ecb-b17f-417b-ab74-3f584959bb3f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:24.211835 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.policy [None req-97064ecb-b17f-417b-ab74-3f584959bb3f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124754) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:24.219329 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-97064ecb-b17f-417b-ab74-3f584959bb3f tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1503 microversion: 2.1 time: 0.153679 Jul 18 17:03:24.219903 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 579/1170] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:24 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:25.237854 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-f7ee3b6b-fd54-461b-9fc6-d7dc84a4ea42 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:25.238463 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-f7ee3b6b-fd54-461b-9fc6-d7dc84a4ea42 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:25.245067 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7ee3b6b-fd54-461b-9fc6-d7dc84a4ea42 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:25.245518 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7ee3b6b-fd54-461b-9fc6-d7dc84a4ea42 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:25.246276 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7ee3b6b-fd54-461b-9fc6-d7dc84a4ea42 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:25.246710 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-f7ee3b6b-fd54-461b-9fc6-d7dc84a4ea42 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:25.378202 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-f7ee3b6b-fd54-461b-9fc6-d7dc84a4ea42 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:25.386734 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-f7ee3b6b-fd54-461b-9fc6-d7dc84a4ea42 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1503 microversion: 2.1 time: 0.153164 Jul 18 17:03:25.387271 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 592/1171] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:25 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:26.179555 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [req-0f051aaa-8f10-4d31-a7c8-aca5b44a8037 req-9d2237b3-bed7-44c7-bea0-6eeab0e7acc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a653fe-0bb9-4be6-9aaa-2cbc885142b3", "name": "network-vif-deleted", "tag": "b01a1653-b96b-4093-b540-b0783b8f34d2"}]} {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:26.190192 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-0f051aaa-8f10-4d31-a7c8-aca5b44a8037 req-9d2237b3-bed7-44c7-bea0-6eeab0e7acc2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:26.190192 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [req-0f051aaa-8f10-4d31-a7c8-aca5b44a8037 req-9d2237b3-bed7-44c7-bea0-6eeab0e7acc2 service nova] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:26.200912 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.compute.server_external_events [req-0f051aaa-8f10-4d31-a7c8-aca5b44a8037 req-9d2237b3-bed7-44c7-bea0-6eeab0e7acc2 service nova] Creating event network-vif-deleted:b01a1653-b96b-4093-b540-b0783b8f34d2 for instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 on hv-cinder-84617 Jul 18 17:03:26.205946 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [req-0f051aaa-8f10-4d31-a7c8-aca5b44a8037 req-9d2237b3-bed7-44c7-bea0-6eeab0e7acc2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030157 Jul 18 17:03:26.206541 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 580/1172] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 18 17:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:26.403931 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.api.openstack.wsgi [None req-cc3b35d0-407d-413d-9d3a-3b47d0a97b78 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:26.404577 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.compute.api [None req-cc3b35d0-407d-413d-9d3a-3b47d0a97b78 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124753) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:26.414356 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc3b35d0-407d-413d-9d3a-3b47d0a97b78 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:26.414837 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc3b35d0-407d-413d-9d3a-3b47d0a97b78 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:26.419714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc3b35d0-407d-413d-9d3a-3b47d0a97b78 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:26.419714 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG oslo_concurrency.lockutils [None req-cc3b35d0-407d-413d-9d3a-3b47d0a97b78 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:26.480666 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: DEBUG nova.policy [None req-cc3b35d0-407d-413d-9d3a-3b47d0a97b78 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6daaa1076f054dd39fdf03017adb0d2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f27a3568f447279e227939696730bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124753) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:26.488479 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO nova.api.openstack.requestlog [None req-cc3b35d0-407d-413d-9d3a-3b47d0a97b78 tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 200 len: 1299 microversion: 2.1 time: 0.088661 Jul 18 17:03:26.489226 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: [pid: 124753|app: 0|req: 593/1173] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:26 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:27.506833 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Calling method '>' {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:27.507570 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.compute.api [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] [instance: 51a653fe-0bb9-4be6-9aaa-2cbc885142b3] Fetching instance by UUID {{(pid=124754) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:27.513964 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:27.514415 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:27.515204 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:27.515624 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG oslo_concurrency.lockutils [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Lock "6070aaf7-16bd-4fe0-b966-c841d36d60dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:27.530181 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.wsgi [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] HTTP exception thrown: Instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 could not be found. Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Request method failure captured: Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: request: GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 HTTP/1.1 Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept: application/json Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Accept-Encoding: identity Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Connection: close Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Length: 0 Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Content-Type: application/json Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Host: 10.222.0.88 Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Openstack-System-Scope: None Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: User-Agent: python-urllib3/1.26.9 Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Auth-Token: gAAAAABi1ZI1tOy_7i-KMXhELmhBXFIh9S2O5cbrzi0DxxV6wgzu4c8Oh0ysmy_9OKCpY-yiEn5SzjSuZijDtbIVH4YP4YpU7J7n50HpkQiftPW6p1C099ila1hb0v2LbjFZ1Wk8C7EHHR7ti2nuw42uctW9ckJRpBr-Sc9A9Mhf6VfzAJaaslQ Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Id: None Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Domain-Name: None Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Identity-Status: Confirmed Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Is-Admin-Project: True Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Id: default Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Domain-Name: Default Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Id: 18f27a3568f447279e227939696730bf Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Project-Name: tempest-VolumesActionsTest-353179771 Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Role: member,reader Jul 18 17:03:27.531872 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Roles: member,reader Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/18f27a3568f447279e227939696730bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/18f27a3568f447279e227939696730bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_18f27a3568f447279e227939696730bf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/18f27a3568f447279e227939696730bf"}]}] Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant: tempest-VolumesActionsTest-353179771 Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Id: 18f27a3568f447279e227939696730bf Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-Tenant-Name: tempest-VolumesActionsTest-353179771 Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User: tempest-VolumesActionsTest-353179771-project Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Id: default Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Domain-Name: Default Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Id: 6daaa1076f054dd39fdf03017adb0d2f Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: X-User-Name: tempest-VolumesActionsTest-353179771-project Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: method: > Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: exception: Instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 could not be found. Jul 18 17:03:27.534026 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: action_args: {'id': '51a653fe-0bb9-4be6-9aaa-2cbc885142b3'} Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: {{(pid=124754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 could not be found. Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:03:27.534900 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 could not be found. Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 could not be found. Jul 18 17:03:27.544717 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: ERROR nova.api.openstack.wsgi Jul 18 17:03:27.547159 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: DEBUG nova.api.openstack.wsgi [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] Returning 404 to user: Instance 51a653fe-0bb9-4be6-9aaa-2cbc885142b3 could not be found. {{(pid=124754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:03:27.547159 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO nova.api.openstack.requestlog [None req-0adae20f-fe12-439b-8633-ce6dd71132ab tempest-VolumesActionsTest-353179771 tempest-VolumesActionsTest-353179771-project] 10.222.0.88 "GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3" status: 404 len: 111 microversion: 2.1 time: 0.031341 Jul 18 17:03:27.547159 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: [pid: 124754|app: 0|req: 581/1174] 10.222.0.88 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:27 2022] GET /compute/v2.1/servers/51a653fe-0bb9-4be6-9aaa-2cbc885142b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:05:10.841133 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:05:10.841653 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Mon Jul 18 17:05:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:05:13.655600 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:05:13.657027 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 17:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:05:17.139030 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:05:17.139628 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Mon Jul 18 17:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:05:18.788572 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:05:18.789358 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 17:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:05:35.850075 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:05:35.850529 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Mon Jul 18 17:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:05:40.847405 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:05:40.847955 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 17:05:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:08:30.851362 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:08:30.852009 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Mon Jul 18 17:08:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:08:33.664068 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:08:33.664634 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 17:08:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:08:37.151176 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:08:37.151751 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Mon Jul 18 17:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:08:38.797217 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:08:38.797799 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 17:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:08:55.858844 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:08:55.859503 dv-cinder-846173-3-iscsi devstack@n-api.service[124753]: Mon Jul 18 17:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:09:00.855766 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:09:00.856401 dv-cinder-846173-3-iscsi devstack@n-api.service[124754]: Mon Jul 18 17:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!